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DEFINITIONS FOR A THEORY OF GAMES AND PURSUIT * 


H. Steinhaus 





INTRODUCTION 


The article which follows appeared in December 1925 in the obscure review ''MySl 
Akademicka'', Lwow, Vol. 1, No. 1, pp. 13-14. It has been mentioned in recent game 
theory literature from Poland but does not seem to be available, even in Polish, in any 
library in the United States. In view of this fact and the obvious historical interest of the 
work, it seems reasonable to publish it in English. The translation which follows is based 
on a version prepared by E. Rzymovski from a photostatic copy provided by S. Ulam. 


Several comments may serve to evaluate the note in its proper historical context. 
At this early date, Professor Steinhaus had a clear idea of the réle of strategy, called a 
"mode of play'' by him, in the process of normalizing a game. Thus, the examples are 
discussed in the abstract form of a payoff function with strategies as independent variables. 
In this form, the best ''mode of play" is defined as that which maximizes the minimum 
expected payoff. Steinhaus clearly recognized that this definition extends to situations with 
a continuum of choices and takes note of the computational difficulties to be encountered 
in both cases. 


At the same time, this note is not as advanced as the earlier Borel papers, which 
made a sharp distinction between pure and mixed strategies and posed the question of the 
Minimax Theorem. The work of von Neumann, which followed in 1926, both by its compre- 
hensive axiomatization and by its proof of the Minimax Theorem, seems to make the pre- 
sent paper a historical curiosity. However, this is a matter of opinion; the translation is 
presented to let the reader decide for himself. 


Harold W. Kuhn 











Mathematical problems have a hierarchy of their own, and it is possible to distinguish 
several classes among them. This classification is not the same as the degree of difficulty of 
the problems. When a layman talks about mathematical problems, he has in mind problems of 
the first class, the lowest level. If one knows the theory of algebraic equations and solves an 
equation using these rules, then he is dealing with a problem of the first class. When one who 
is not familiar with the theory of mathematical equations considers whether every mathematical 
€quation has a solution, he poses a higher level problem in the second class of the hierarchy. 
When he notices that the equation x* + 1=0 has no solution in the domain of real numbers, he 
will try to define a new kind of numbers which would make possible the solution of any algebraic 


equation, and must deal with a problem of the third class, that is, of an even higher order in 
our classification. 


* . 
Immediately following this paper is a letter from Professor Steinhaus to the Editors of the 


Quarterly, in which he gives permission to publish his paper and adds a few comments of 
interest. 
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The aim of this paper is to give some examples of problems of the third class. It wij 
be concerned with problems beyond the strict boundaries of mathematics. Let us consider, as 
a first example, the game of Chess; in particular, the definition of the ''best move" in given 
circumstances. The "best move" for White is that which permits him to mate his opponent jn 
the least number of moves. It is obvious that circumstances may occur when such a move is 
not possible; then we can define the “best move" as that which leads to the quickest "draw," or 
to the highest number of moves of the losing party. To simplify our considerations, we shall 
forget about a draw. The definition given above does not make much sense since (except when 
it is possible to mate in one move) none of the moves of White can lead to an immediate victory 
even if the position is winning, because after that a move of Black will follow, and then another 
"best move" of White will have to be found, and soon. Then the "best move" of White isa 
move which, after another move of Black, gives him a better position than any other move 
would give. But this definition is incomplete because sometimes a ''worse move,"' after which 
Black unwisely makes a wrong move, can put White in an even better position than if the game 
had been played cautiously. Our previous definition must be supplemented by adding that the 
"best move" of White is that which after the ''best move" of Black, puts White in a better posi- 
tion than any other possible move would do after the "best move" of Black. But now we are in 
a vicious circle because we have defined the ''best move" of White by the "best move" of Black. 

To escape from these difficulties, we shall introduce a new definition: a 'mode of 
play."' A "mode of play"' for White means a list of all possible circumstances with a preferred 


move for each. It is obvious that this list should not include circumstances which can never 


occur (e.g., if in an "end game" White has only the king and the rooks, then it is not necessary 2 
to consider the position of pawns). It is possible to define a "mode of play" for Black in the 


same way. If White adheres to the "mode of play" B, and Black to the ''mode of play" C, then 


the number of moves is completely defined. Let 4 be the number of moves from the beginning 
of the game to the end; / is a function of B and C, 

L= F(B,C), 
and, given B, £ depends only on C. 


Assuming B is known, Black will choose that "mode of play" Cy (which depends on B), 


Cy = F , (B) 


which gives him the longest defence. Such a "mode of play" means that 4 = F(B,C,) is longest; 
max = F(B, F,(B)). 


Now let us choose a "mode of play" By such that F(Bp, F | (Bp)) is a minimum. 
Then the mode B, is the best "mode of play" for White, the corresponding move for 
0 
White is the "best move," and 
4 = F(Bp; F | (Bp)) 

is the lowest number of moves that White can guarantee not to exceed. Black, using his best 
"mode of play,'' can defend himself for at least Lo - 1 moves. 

The mathematical method which has been used for the game of Chess can also be appli 


to a similar problem from tactics: one ship is pursuing another—find the best way of pursult 





ongest; 


» then B. is the "best mode of play" for A. 
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If the ocean is unlimited the problem is a simple one. The problem is more complicated if we 


assume some obstacles and limits to the ocean's extent. Let us call a "mode of pursuit" a 
function B(x; , Y4»%Xq» Yo): which gives the angle between the line of sight, connecting positions 
(x,+¥,) of the pursuing ship and (Xo, Yo) of the escaping ship, and the direction of steering. Let 
us call a "mode of escape" a function C(x,, ¥19%o» Yo)» which represents the angle of steering of 
the escaping ship. The speed of each ship is given. If t = F(B,C) means the duration of the 
chase from the beginning to the end of the manoeuvre, then, given B, we should find a "mode 

of escape" Cy = E | (B) which gives the maximum value for t, 


a om = F(B, Co): 


Now we should find a mode of pursuit By which makes F(Bp, F | (Bo) a minimum. It can 


be shown that, if the pursuing ship has a higher speed than the other ship, then a finite value 


fort, is obtained. Then B is the shortest length of the 


0 0 0 
chase which the captain of the chasing ship can guarantee. We must remember that it is pos- 


is the "best mode of pursuit" and t 


sible that, using another ''mode of pursuit" than B,, the other ship could be caught in a shorter 


0’ 


time than t,, but this can happen only if the escaping ship chooses wrong tactics. This is the 


0’ 
reason why quite often a bad player, using wrong tactics against another bad player, wins a 
game in a shorter time than a good player would. Using the best tactics, the escaping ship 


can guarantee that she will not be caught in a time less than t If the pursuing ship chooses 


a method of pursuit different from Bo: assuming that the aad ship will make a mistake, 
there is a risk that the time to will not be sufficient to catch the ship. 

The same method can be applied also to games of chance. Although many circumstances 
are unknown to the player, nevertheless the bid, the cards which have been displayed, and his 
own cards are known to him; these are the given factors of the game. If we call B the "mode 


of play" which player A is playing in given circumstances, and C the "mode of play" of the 


) opponent, then the expectation N of player A is given by N = F(B,C). It is necessary again to 


find Co so that N is a minimum, and then Bo» so that N, would assume its maximum value; 


0 


0 
The analogy is complete. We solved the problems of the third class in the same way in 


, all three examples, but we have obtained only definitions. We know what we mean by the "best 


move,"’ the "best pursuit,'' and the "best way of playing" card games. If we want to find the 


) "best move" in a concrete case, we encounter enormous difficulties in solving the problem of 
the second class. This is dealt with by the theory of chess. If we want to consider a concrete 
| example of pursuit, we shall have to use the calculus of variations on a very difficult problem 
of mathematical analysis. Problems of card games in the simplest of circumstances lead to 

| Very involved combinatorial calculations. You can see that the problems of the lower classes 
» *re more difficult than the problems of the highest class, which consist of finding definitions, 
) but without finding these fundamental definitions it would be impossible to state the problems 


| for the lower classes. We found an analogy among three problems which looked so different: 


each leads to finding minima and corresponding maxima of the function F of two independent 
Variables B and C. 
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H. Steinhaus Wroctaw, 5 November 1959. 
Wroctaw 12, ul. Ortowskiego 15. 


Commander Harris P. Jones, 

Managing Editor of the Naval Research Logistics Quarterly, 
Department of the Navy, Office of Naval Research, 
Washington 25,D.C. 


Dear Sir, 

This is to answer your request of 14 October, ONR:436:HPJ:rnk, concerning the 
paper "Definitions for a Theory of Games and Pursuit." 

This paper of mine [was] published in 1925 in an ephemeral pamphlet called '"Mysl 
Akademicka."' The "Vol.1, No 1" had less than 20 pages, and I think that No. 2 was the last 
issue. The editors were students of the University and of the Polytechnic School in Lwow. 
They have not acquired the authors rights: it was a welfare action for the sake of the students’ 
social organizations to which I contributed, answering a request of the editors as a professor 
of the University. Thus, there is no objection against publishing an English version in your 
Quarterly. 

Until 1957 I was unable to ascertain the date of the paper. I have even promiseda 
reward to anybody who would find a copy. Finally Prof. Ajdukiewicz promised me lhe would] 
enquire about a copy in Lwow (the city belongs to the Ukrainian Republic, thus to the Soviet 
Union). He brought me the copy of 'Mysl Akademicka" owned by the Library of the Lwéw 
University so that I could make some photostatic copies therefrom. 

The introduction written by Professor Harold W. Kuhn is based on the text of my 
paper and on the information about the theory of games, or rather about the history of this 
theory. Let me write here a few lines about my own reminiscences: 

I was especially interested in naval pursuit. After having found the concepts of 
minimax and maximin I was well aware that the minimax time of the pursuer is longer or equal 
to the maximin time of the pursued, but I did not know whether they are equal in all similar 
games. Consequently, I called "closed" the games for which there is equality and "open" the 


other ones. My pupils in Poland have adopted later this terminology (thus the pursuit of one 


ship by two is closed, and it is open when there are three pursuers). I have applied my theory 


to a game of cards called "baccara''—it is a gam=2 of two persons which gives to the banker 4 
better situation than to his opponent. I could find the best strategies by iteration: the third 


approximation is already equal to the second one. None of these things are published. 


Sincerely yours, 


(Signed) H. Steinhavs 





DESIGN, TEST, AND EVALUATION OF AN 
EXPERIMENTAL FLYAWAY KIT 


Bernard Okun 


Princeton University 





This article describes and analyzes the results of an F-100D 
flyaway-kit test. The purpose of the test was to compare the effective- 
ness of six alternative flyaway kits and evaluate the merits of the RAND 
flyaway-kit method. Consumption data were collected for a 30-day 
period from two F-100D squadrons stationed in West Germany and were 
then compared with the contents of each kit, whose effectiveness was 
measured in terms of its ability to satisfy the squadron's demands for 
spare parts. The major finding of the test was that the RAND-SMAMA 
dents’ kits provided greater coverage, even though they weighed less than the 
TAC and USAFE kits. It was found that further progress is needed in 
two directions: (1) the collection of accurate spare-parts consumption 
our : data; (2) the compilation of complete and accurate Master Parts Lists. 

: As it is made, the RAND flyaway-kit method should prove highly satis- 
factory. 


Ssor 


The F-100D flyaway -kit project described inthis article involved 
the cooperative efforts of the Sacramento Air Material Area (SMAMA), 
Headquarters Tactical Air Command (TAC), United States Air Forces 
Europe (USAFE), Air Material Forces European Area (AMFEA), and 
the RAND Corporation. Throughout, the project benefited from the 
contributions of many people, including the following: W. R. Huffman, 
B. Peterson, G. P. Johnson, B. P. Strathman, W. H. Winkler, B. P. 
Yhnell, E. Dorwart, Lt. D. Pope, and J. White of SMAMA; Lt. Col 
R. F. Kendrick of TAC;and M. Astrachan, Bernice Brown, D. M. Fort, 
andA. H. Rosenthal of the RANDCorporation. Special acknowledgment 
is due Mary Ann Peters of the RAND Corporation for the computations 
and thorough checking of the entire manuscript. 
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ss INTRODUCTION 
n" the 

i The flyaway kits described in this study are sets of spare parts which enable squadrons 
y . . 

thea to maintain their own airplanes for a given time period when cut off from outside supply and 
ker a 


maintenance. Designers of such kits face the knotty problem of reaching an effective com- 
hird 


promise among a complex of closely related factors. They must, for example, estimate the 
probability of demand for various items, consider their essentiality and installability, collect 
data on their unit weight and unit pack, and reach a compromise between depth and breadth of 


Coverage—all within imposed limitations of weight and perhaps size. Broadly speaking, the 


en 


Manuscript received January 6, 1959. 
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objective is to minimize the loss in combat effectiveness of a given number of aircraft for q 
given period due to lack of supply support. 

Several years ago the Logistics Department of The RAND Corporation developed a 
method for designing flyaway kits. This procedure has been described in detail in two earlier 
RAND Research Memoranda, which the reader who is unfamiliar with the RAND method may 
consult.’ These studies dealt with flyaway-kit tests for the B-47 and F-86H and showed such 
promise that a recent amendment to Air Force Manual 67-1 specifies flyaway-kit design pro- 
cedures based on the RAND method. . 

The present study deals with the history and results of a subsequent kit test for the 
F-100D,° which embodied some improvements over the F-86H test and which, it was hoped, 


would lead to still further improvements. 


THE DEVELOPMENT OF AN EXPERIMENTAL F-100D FLYAWAY KIT 


Concepts and Data Requirements 

The basic function of a flyaway kit is to minimize a squadron's loss in combat effective. 
ness caused by the lack of spare parts. Weight was the only limitation on the size of the RAND 
SMAMA experimental kits. 

The kits with which we are concerned were designed to support a squadron of 25 F-100) 
aircraft for a 30-day period. It was assumed that nothing beyond squadron-level maintenance 
equipment and personnel would be available. By squadron-level maintenance we refer to the 
concept in operation prior to the reorganization of wings from 25- to 18-aircraft component 
squadrons. In the current context, we mean squadron maintenance augmented by personnel 
and equipment from the Armament and Electronics and Consolidated Aircraft Maintenance 
Squadrons. 

Weight limitations of 15,000, 20,000, and 25,000 pounds were imposed on the three 
experimental kits to be designed and tested. TAC maintenance personnel were then to examine 
them and suggest 5,000 pounds of spare parts to be added to the contents of each. 

As a result of the above requirements and limitations, it was necessary to ascertain 
several characteristics of each spare part considered for inclusion in the kit: 

(1) Unit weights, since total weight was the limiting factor; 


(2) Expected mean demand, usually based on past observations; 


1 
H. W. Karr, M. A. Geisler, and Bernice Brown, ''A Preferred Method for Designing a 


Flyaway Kit, '' The RAND Corporation, Research Memorandum RM-1490 (ASTIA Document 
No. AD 87175), May 19, 1955 (Confidential); D. M. Fort, "Experimental Design and Evalua- 
tion of an F-86H Flyaway Kit,'' The RAND Corporation, Research Memorandum RM-2062 
(ASTIA Document No. Ad 144287), December 18, 1957 (Unclassified). 


2 
Amendment 62 (15 September 1958) to AFM 67-1, Vol. III, Section 21, Paragraph 9, and 
Supplement I, Part B. 


3 ‘ ; ; 
The F-100D is a jet fighter plane used primarily by the Tactical Air Command. 
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(3) Relative essentiality; 

(4) Installability of the part, since only squadron-level maintenance was assumed to be 
available. 

It may be well to note briefly the basic concepts underlying the RAND procedures. 
Recognizing that actual demand for a spare part fluctuates about the expected (or mean) demand 
rate, the RAND procedure adopts a probability approach to demand. It applies probability 
distribution tables to expected demand rates in order to generate a demand-probability distri- 
pution for each spare part? These tables indicate the various probabilities that a number of 
wits (0, 1, 2, 3, etc.) will be demanded for each spare part, given the part's mean demand 
rate. The demand probabilities for all spare parts are then weighted by the appropriate 
essentiality-installability coefficients and divided by the relevant unit weights. The units of 
the spare parts are then arrayed and various quantities inserted in the kit according to the 
additional protection per pound that they contribute to the kit. The additional protection of a 
wit is measured in terms of the probability that it will be demanded, weighted by its relative 
essentiality and installability. With this theory in mind, we may now pass on to the actual 


steps taken in preparing the F-100D experimental kits. 


Preparation of The Kit 
Master Parts List (MPL) 
An initial step in the RAND method is to prepare a Master Parts List. Theoretically, 





the MPL includes all replaceable spare parts (except the engine) and contains information on 
stock number, unit weight, unit pack, and unit cost for each part. The MPL compiled at 
SMAMA for the F-100D contained all of this information except unit cost and unit pack. 

Information for the MPL came from failure or usage reports and from documents used 
in provisioning conferences. It should be stressed, however, that the MPL should not be 
restricted solely to those parts which the Air Force procures; rather, it should list all re- 
placeable parts, procured or not. Since the MPL functions as the only list of spare parts 
considered for inciusion in the kit, an incomplete MPL is likely to cause an inadequate flyaway 
kit. 

Installability 

Given the list of spare-part candidates, it is essential to determine the installability of 
tach. For this purpose a conference was held at SMAMA and attended by maintenance special- 


ists from TAC. The conferees reviewed each spare part to determine whether or not it was 


nh the F-100D flyaway-kit computation, the Poisson probability distribution was used. The use 
of the Poisson is a theoretical assumption, which was not tested on an empirical basis. Apply- 
ing it to every spare part is a questionable procedure. There are, however, some theoretical 
grounds for applying the poisson to generate a theoretical demand-probability distribution for 
asparepart. P, the probability of a failure in a given trial, is small relative to NP, and NP is 
small relative to N, where N represents the number of trials. Since N is large and unknown, 

the Poisson is particularly useful. See Alexander M. Mood, Introduction to the Theory of 
Statistics (McGraw-Hill, New York, 1950, p. 61). 
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installable at squadron level. If considered noninstallable on the squadron level, it was as- 
signed a coefficient of 0.000, which automatically excluded it from the kit. If it was considerg 
installable, the conferees then assessed its relative essentiality. 


Essentiality-Installability Index 





After dealing with the installability problem, the conferees assigned an essentiality 
factor to each item. The following joint essentiality-installability index was constructed: 
1.000 - installable part whose failure would ground the aircraft, 
0.300 - installable part whose failure would limit but not cancel the combat effectiveness 
of the aircraft, 
.100 - same as 1.000, except that "its absence could be compensated for by substitu- 
tion or local manufacture," 
.030 - same as .300, except that "its absence could be compensated for by substitution 
or local manufacture," 
-001 - installable part whose failure would not affect the combat readiness of the air- 
craft, 
0.000 - noninstallable part at squadron level. 
The conferees assigned one of these coefficients to each of the candidate parts. All 
parts were admissible to the flyaway kit except the noninstallable (0.000) parts. 
Expected Demand 





Additional information required in flyaway-kit computation is the mean or expected 
demand rate for each spare part. It is therefore necessary to collect parts-consumption data 
since expected demand rates are computed from past experience. 

For a period of ten months, spare-parts-consumption data were collected at Langley 
AFB, Virginia, and Cannon AFB, New Mexico. It was agreed to collect them from the primar 
source, the mechanics who maintained the aircraft. For non-benchstock items, modified 
USAF Product Improvement Program (PIP) forms were used to record data. In particular, 


mechanics were asked to complete Forms AFT033 (Aircraft Missile and Support Equipment 


Failure and Usage Report) and DD 787-1 (Electronics Failure Report). For purposes of flyawa 


kit computation, these forms provided a list of spare parts and the quantity of each used ina 
number of F-100D aircraft. 

For benchstock line items, a different procedure was used. Inventories were taken at 
the beginning and end of the data-collection period. For each part, the terminal inventory 


level was subtracted from the initial level. The number of units issued by base supply to the 


squadrons during the intervening period was then added to the inventory stock-level differential 


thus providing an estimate of consumption during the period. 
All of the above consumption information was processed and tabulated, yielding data 0 
the total consumption of each spare part during the 10-month data-collection period. 
SMAMA then converted these total consumption figures to mean squadron-demand rates, 
dividing the total consumption figure for each spare part by the number of squadron-months. 


A squadron-month is defined as 25 aircraft-months; an aircraft-month represents an aircraft 
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assigned to the data-collection program for 30 days. There were about 52 squadron-months 
in all. 

Note that the consumption data were standardized for a 25-aircraft squadron, the official 
configuration during the time period in which the data were collected. On the other hand, the 
flyaway kits were subsequently tested in Germany with a 15- anda 16-aircraft squadron anda 
combination of the two. It appears, however, that this discrepancy in squadron size did not 


affect the conclusiveness of the test results. 


Summary of The Input Data 
It may be well to summarize some of the actual input data which we have merely de- 


scribed up till now. In all, 24,474 line items were listed in the MPL and considered for 


: inclusion in the flyaway kits.” Table 1 lists their distribution by essentiality-installability. 


Note that 3811 line items were excluded TABLE 1 
Number Of Line Items, By 


from the kits for being noninstallable at the Essentiality-Installability 





squadron level. About 34 percent (the largest 
Essentiality- Number of 
Installability Line Items 


0.000 3, 811 
installable, not easily replaceable by substi- 0.001 2.418 


class) of the line items were assigned a coef- 








ficient of 1.000; that is, they were considered 


tutes, and absolutely essential to the combat ef- 0.030 191 


fectiveness of the aircraft. 0.100 4,747 


In the distribution of line items by mean 0. 300 4.980 
” > 


squadron demand (shown in Table 2), the most 1.000 8,327 
striking finding is that 20,986, or about 86 per- 


24, 474 














cent, of the candidate line items experienced no 
consumption at Cannon and Langley AFB's during the reporting period. These items were 
arbitrarily assigned a mean squadron-month demand of 0.006. They were assigned this non- 
zero demand rate so they could be included in the kit if their unit weight was sufficiently low 
inrelation to their essentiality-installability coefficient. 

The third important variable in flyaway-kit computation, in addition to expected demand 
and essentiality-installability, is unit weight. Table 3 shows the distribution of candidate line 
items by unit weight. 

This table reveals that a very large proportion of the candidate line items are light- 


weight. About 81 percent weigh less than one pound, and about 96 percent weigh less than 


ten pounds. 


oe 


5 

By line items'' we mean "unique items.'' For a unique part with more than one stock number, 
there was to be a consolidated and single listing in the MPL for that part. In the preparation 
of the MPL, where one is confronted with so many line items, a few cases of duplication may 
arise, i.e., a unique part may be erroneously listed in more than one place under a different 
stock number. 
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TABLE 3 Description of The RAND-SMAMA Flyaway Kits 
Number of LineItems, By Unit Weight 





Using the input data described in the 
Unit Weight Number of 


(1b) Line Items preceding section, SMAMA applied the RAND 








procedure and computed kits weighing 15, 000, 
0. 01 1, 982 


. 02 - - 05 2, 203 
. 06 - . 09 1, 307 


20, 000, and 25, 000 niin” Perhaps their 
0 0 
0 0 
0.10- 0.29 | 4, 028 
0 0 
1 2 
3 9 


most striking feature is the large number of 
line items they contain. It will be recalled that 


there were 24, 474 candidate line items. Of 
30 - . 99 10, 342 


- 00 - - 99 2,581 

- 00 - - 99 1, 036 
10.00 - 29.99 478 
30.00 - 99.99 
100. 00 - 299. 99 
300. 00 and over 





these, 20,663 were considered installable at 

squadron level and therefore admissible to the paring | 
kits. Of these 20, 663 eligible candidates, the of cour 
15K kit listed 14, 866 or 72 percent; the 20K kit Nevertt 
listed 16, 779 or 81 percent; and the 25K kit liste not den 
17,813 or 86 percent. These figures are in sla inclusic 
contrast with the approximately 2200 line items" it is thc 
the TAC kit and the 1809 items in the USAFE ki ® items. 








= 


The experimental kits were computed m 
the basis of an incomplete MPL. Had it been by unit 
complete, it is evident that the experimental was adr 
flyaway kits would have contained an even larger number of line items. This is because the 
RAND-SMAMA methodology is designed so that at least one unit of each line item listed in the ed by a 


MPL, including line items with zero demand during the preliminary data-collection period, wil & instala 


6 
Hereafter referred to as kits 15K, 20K, and 25K, respectively. 
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pe included unless the line item has a very low essentiality-installability rating, a very high 
} weight, or poth. The arbitrary assignment of a mean demand rate of 0. 006 to zero-demand 
| jarts is responsible for this. 

Table 4 summarizes the line-item composition of the experimental kits by essentiality- 
installability. It indicates that among the candidate line items with essentiality-installability 
coefficients of less than 0. 100 only a small percentage succeeded in entering the flyaway kits. 

On the other hand, as expected, most of the line items with coefficients of 0.300 and 1. 000 were 
included. This suggests that the assignment of essentiality-installability factors does signifi- 


cantly affect the line-item composition of the flyaway kits. 


TABLE 4 
Number Of Line Items In The RAND-SMAMA Kits, 
By Essentiality-Installability 
pete. —_—— 
Essentiality - 15K Kit 20K Kit Kit “ 
Installability | | Candidates* | 





| 








0. 000 ~ | 3, 811 
0. 001 | 28 49 | | 2, 418 
0. 030 | 44 | 60 | | 191 
0. 100 2,841 4,169 | 4,747 
0.300 | 4, 345 4,600 | 4,980 
1. 000 | 7, 608 7,901 | | 8, 327 





16, 779 | | 24, 474 


ee | 


14, 866 | 


*From Table 1. 


Table 5 summarizes the line-item composition of the kits by mean demand rate. Com- 
paring the kits' contents with the candidate distribution in the right-hand column, we observe, 
ofcourse, that it was primarily the low-demand group which failed to enter the flyaway kits. 

; Nevertheless, it is interesting to note that 13, 604 of the 16, 779 line items in the 20K kit were 
not demanded at Langley and Cannon AFB's during the data-collection period. This deliberate 
inclusion of many low-demand items is an important characteristic of the RAND-SMAMA kits; 
itis thought desirable because of the unpredictable nature of the demand for individual line- 
items. 

Finally, we pass to Table 6, which summarizes the line-item composition of the kits 
by unit weight. Since only a small proportion of those candidates weighing 10 pounds or more 
was admitted into the kits, it is apparent that weight was influential in the selection. 

We have described above the contents of 15K, 20K, and 25K RAND-SMAMA kits, select- 
ed by a systematic computational procedure. In general, of course, it was the low-essentiality- 


installability, low-demand, and high-unit-weight candidate line items which were excluded. 





Number of Line Items In The RAND-SMAMA Kits, 


TABLE 5 


By Mean Demand Rate 





Mean Demand 
Rate (Units/ 
Sqdn- Month) 


15K Kit 


20K Kit 


Kit 
Candidates # 








. 006° 

. 020 

-030- 0.099 
-100- 0.299 
-300 - 0.999 
-000 - 2.999 
-000 - 9.999 
- 000 - 29.999 
. 000 & over 


81 
14 
6 


13, 604 
685 
847 
666 
613 
263 

81 
14 
6 


81 
14 
6 


= 
20, 986 
820 
941 








Total 





14, 866 





16, 779 





17, 813 











*From Table 2. 


Zero-demand items arbitrarily assigned a demand-rate of . 006. 


TABLE 6 


Number of Line Items In The RAND-SMAMA Kits, By Unit Weight 





Unit Weight 
(1b) 


15K Kit 


20K Kit 


25K Kit 


Kit 
Candidates* 








. 01 - 

-02- 0.05 
-06- 0.09 
-10- 0.29 
-30- 0.99 
-00- 2.99 
-00- 9.99 
.00- 29.99 
-00- 99.99 
. 00 - 299. 99 
.00 & over 


1, 487 
1,561 
996 
2,998 
6, 204 
1, 281 
273 
54 

21 

1 

0 


1, 487 
1, 566 
1, 002 
3,016 
7, 541 
1, 526 
532 
81 

33 

4 

0 


1, 743 
1, 566 
1,006 
3, 026 
7, 706 
1, 849 
647 
222 
43 

4 

1 


1, 982 
2, 203 
1, 307 
4, 028 
10, 342 
2,581 
1, 036 
478 
285 
90 
142 





Total 

















24, 474 
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THE F-100D FLYAWAY KIT TEST 
Nature Of The Test 

The previous section outlined the procedure followed in developing the experimental 
flyaway kits. This section describes and analyzes the findings of the test, conducted by 
sMAMA, TAC, and The RAND Corporation. 


The test involved an evaluation and comparison of the effectiveness of the following six 


flyaway kits: 
(1) The RAND-SMAMA experimental 15K kit; 
(2) The RAND-SMAMA experimental 20K kit; 
The RAND-SMAMA experimental 25K kit; 
(4) The RAND-SMAMA experimental 20K kit augmented by 5000 pounds of judgment 
items (20K+J) submitted by TAC maintenance personnel of Langley AFB; ’ 


(5) The in-use TAC flyaway kit, which weighs about 37, 000 pounds; 
(6) The USAFE Dispersal Kit, weighing about 45, 000 pounds, used by squadrons of 
the 20th Fighter Bomber Wing. 8 

Two TAC squadrons of F-100D aircraft participated in the test. They were based at 
Landstuhl and Bitburg, Germany, and will be referred to here as Squadrons L and B. 

The actual test period ran from January 15 through February 14, 1958. Squadron L 
consisted of 15 F-100D's and flew 391 hours during the test period; Squadron B consisted of 
16 F-100D's and flew 388 hours. (All of B's flying hours were accumulated during the second 
half of the test period, since bad weather precluded flying during the first half. ) 

The test was essentially a data-collection project. Squadron maintenance people were 
instructed to report all spare-parts consumption generated at squadron-level maintenance. To 
facilitate this reporting, simple failure-reporting cards were distributed to the mechanics, 
who were instructed to record the following information for every spare part consumed; (1) 
the stock number and quantity of units used; (2) parts repaired in place; (3) parts removed, 
repaired, and replaced by maintenance; (4) parts removed and replaced by other parts; and 
(5) parts removed but not reparable by squadron maintenance. Representatives from SMAMA, 
TAC, and The RAND Corporation were available at Landstuhl and Bitburg to answer questions 


and monitor the data collection. 


Summary Of The Consumption Data 
Table 7 is a summary list of squadron demands for spare parts by Air Force property 


class, with separate data for Squadrons L and B and for the two squadrons combined (referred 

7 

The "judgment" items refer to additions to the 20K kit which, based on the personal experience 
ofthe TAC maintenance personnel, should be added to the kit. These are in addition to the 


original entries, which were selected on the basis of the RAND-SMAMA methodology. 
8 


Note that while the TAC and USAFE kits were substantially heavier than the experimental kits, 
they contained far less line items--2200 and 1809, respectively. This is attributable partly to 
the smaller emphasis placed on line-item weight as a basis for exclusion by TAC and USAFE 
and partly to the tendency of TAC and SMAMA to stock in greater depth (more units per line 
item) at the sacrifice of range. 
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to as Squadron C). It is interesting to observe both the wide range in the kinds of spare parts 


demanded by B and L and the disparity in the parts demanded by B and L. : Measu 


Squadron C consolidates the demands of L and B as if they were generated by a single 
31-aircraft squadron. In one sense, then, flyaway kits were tested for a total of three squad- | lemof 


ron configurations. » each o 
squad1 


TABLE 7 oats 
Summary Of Squadron Demands For Spare Parts difficu 


(Line Items) culties 





Squadron Demands 
Property Description 


Class L ey | been e 


== SSS measu: 


01-M-PC Airframe, common | $ later u 
01-M-F100 Airframe, peculiar | 26 
| 34 











02-H Engine parts 

03-B Wheels, brakes 

03-C Aircraft electrical equipment 

03-D Carburetors 

03-F Miscellaneous accessories 

03-G Hydraulic struts, actuating cylinders 
03-H Ignition-system accessories 

03-I Fuel system 

03-J Miscellaneous aircraft-engine accessories 
03-K Aircraft Breathing-Oxygen Equipment 
04-A Aircraft hardware 

04-B Rubber materials 

04-C Tire casings, tubes 

05-A Aircraft navigation instruments 

05-C Aircraft flight instruments 

05-D Aircraft engine instruments 

05-F Aircraft autopilots & gyro control mechanisms 
05-G Miscellaneous aircraft instruments 
06-B Lubricants, corrosion preventives 

07 Paints, soaps, dopes 

08-A Commercial electrical equipment 
08-G Lamps, fuses 

11 Aircraft armament 

16-A Airborne radio-communication equipment 
16-K Airborne radar equipment 

16-Q Resistors 

16-R Switches, circuit breakers 

16-S Electron tubes 

16-T Relays, contractors, solenoids 

21-A Textiles, leather, fur, cordage 

23-A Metals, ferrous and nonferrous 

29 Commercial hardware 

29-C Nails, keys, pins 

29-H Rivets 

39-B Ammunition 
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Total 141 109 | 226%) 


*The total for C is less than the sum of the totals for L and B because some line items were 
demanded by both L and B. This total of 226 represents a small fraction of the 24, 474 candi 
date line items listed in the MPL. 
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Measures Of Flyaway-Kit Performance 

Having collected and compiled the consumption data, we next faced the complex prob- 
jem of measuring the effectiveness of the flyaway kits by collating the consumption data with 
each of the flyaway-kit listings. The ideal flyaway kit is one which minimizes the loss of a 
squadron's combat power caused by the unavailability of spare parts, given some constraint 
on the size of the kit (such as a weight limitation). In practice, however, it is extremely 
difficult to adhere strictly to this criterion when evaluating flyaway kits, because of the diffi- 
culties involved in measurement. 

In the following analysis, four basic measures of the effectiveness of flyaway kits have 
been employed. Each appraises a somewhat different aspect of kit performance. These 
measures are also adjusted by essentiality-installability, a modification which is explained 
later under ''Findings. "' 

Before turning to the variables employed in evaluating the kits, we should distinguish 
between the terms "line item" and "unit."' A line item is a specific part, such as a particular 
type of tabwasher. When interchangeable or substitute parts are available, they are treated as 
asingle line item. Units refer simply to quantities of a part in the kit. Thus, a kit could 


consist of 10 line items, stocked in quantities of 3 units each, making a total of 30 units. 


(1) 


ing the breadth or range of coverage provided by a kit. It relates the number of demanded line 


Demanded Line Items Listed 


Bg ce ee This first basic variable is best suited for measur- 





items which are listed or included in the kit (in any quantity) to the total number of line items 
demanded. It does not reflect the depth of a kit's coverage; that is, a kit receives credit for 


listing a line item whether or not it contains enough units to meet the total demand. 


(2) Line Items Fully Covered 
Demanded Line Items Listed. 





This second variable measures the depth of cover- 


age of a kit in a narrow sense, relating the number of line items fully covered by the kit to the 
number of demanded line items listed in any quantity. It is clearly a very narrow measure of 

one aspect of kit performance (depth of coverage), and should not be taken alone as a measure 
of kit effectiveness. While it does not penalize a kit for failing to list a demanded line item, it 


does penalize it for failing to stock enough units to meet the demand. 





(3) Line Items Fully Covered 


ay ay ee The third variable in the analysis deals with the rela- 


tionship between the number of line items demanded and the number listed in the kit in adequate 


quantity to cover the demand fully. This variable is the product of variables (1) and (2): 


Demanded Line Items Listed x Line Items Fully Covered _ 
Line Items Demanded Demanded Line Items Listed ~ 








Line Items Fully Covered 
Line Items Demanded ° 





Of the three variables, the third is the best general measure of flyaway-kit performance, 
being a function of the breadth and depth of coverage. 





(4) Units Supplied 
Units Demanded’ 


and supplied, without regard to line items. It is the ratio of the total number of units supplig 





The fourth and last measure relates only to units demanded 


to the total number of units demanded. This measure places great weight on the benchstock 


classes, wherein line items are generally demanded in comparatively large quantities. 


Findings 


We now pass to a review and analysis of the findings of the test. In addition to evaluatin i 


and comparing six flyaway kits, this section will attempt to set forth several defects of the 


RAND-SMAMA experimental kits, point to their causes, and suggest possible remedies. 


Line Items Demanded 





We begin by examining the number of line items demanded. The squadron based at 
Bitburg consumed 109 different line items; the squadron based at Landstuhl consumed 141. 
addition to treating Squadron B and L data separately, we have treated the B and L requests as 
if they were generated by a single squadron, Squadron C. This consolidation results ina 
combined demand for 226 different line items. Of these, B demanded 48 percent and L 62 per. 
cent. 

The sum of the above percentages exceeds 100 because 24 line items were jointly 
demanded by Band L. That only 24 line items of 226 were jointly demanded is noteworthy 
but not surprising. It simply reaffirms a well-known fact: that there is much uncertainty 
attached to spare-parts failures, and the failure experience of different squadrons or of the 
same squadron at different points in time is subject to much variation. This fact points to the 
need for a flyaway kit which contains a wide range of line items, a characteristic which 
distinguishes the RAND-SMAMA experimental kits from those currently used by TAC and 
USAFE. 

The line-item demand data, as well as all other data to be discussed, have been divided 
into five classes. One class consists of all line items in Air Force Property Class 02-Hl. 
Almost all the line items in this class consumed at B and L are benchstock items (such as 
gaskets, seals, and washers). Because they are engine parts of the benchstock type and are 
easily recognizable as Pratt-Whitney Engine Parts (having either an 0245 Air Force Class 
number or a 2840 Federal Supply Class code number), it was decided to group them intoa 
unique class and identify them as engine benchstock. 

This class accounted for only about 4 percent of L's line-item consumption, but almost 
30 percent of B's. This striking difference, it will be seen, explains a sizable part of the 
difference in kit performance at B and .” 

A second class of line items, to be referred to as other benchstock, consists of most 


benchstock items not already included in the engine-benchstock class. Because benchstock 


consumption was reported in a different manner from other consumption at the Langley-Canu 


B's high engine-benchstock consumption results partly from the completion of several 50-ho 


engine periodics. Although these periodics may also have been performed at L, the consum} 


tion of spare parts they generated was not reported. 
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data-collection project, and because it sometimes occurs in multiple units, it is desirable to 
treat other benchstock as a special class. The other-benchstock class accounts for 45 percent 
of L's line-item consumption and about 28 percent of B's. 

A third class of items, recognized by its 1AML prefix, consists of "airframe and 
aircraft structural parts" peculiar to the North American F-100D aircraft. The Master Parts 
List contains a relatively large number of LAML items. For this reason, the 1AML (or 01-M) 
items have been treated as a separate class, which will be referred to as F-100D peculiar. 

The F-100D-peculiar class accounts for about 14 percent of L's line-item consumption and 
about 5 percent of B's. 

A fourth class consists of all 'non-each" line items. The non-each class contains 
line items whose "units" are naturally continuous (as opposed to discrete), such as wire, oil, 
and grease. The non-each items are treated separately because the RAND-SMAMA procedure, 
when the Poisson distribution is utilized, is not applicable to continuous variates since the 
Poisson is a discrete variate distribution. Only 44 percent of the non-each line items demanded 
were included in the MPL. Also, for purposes of measuring consumption, the non-each class 
presents a problem. For example, if oil demanded is measured in quarts, the quantity of 
units demanded appears to be four times what it would be if the oil were measured in gallons. 
Thus, unit analyses could not (and will not) be applied to non-each items. For all of the above 
reasons, the non-each items were treated separately. Where a non-each item is also a bench- 
stock item, it is classified as non-each. This class accounts for about 9 percent of L's and 5 
percent of B's line-item consumption. 

A fifth and final class, the residual class, includes all line items not in any of the other 
categories. Types of items in this class are electronics, instruments, tires, brakes, and 
electrical equipment not included under benchstock. It is characterized by the absence of 
benchstock, F-100D-peculiar, and non-each items. About 28 percent of L's and 32 percent of 


B's line-item consumption is accounted for by the residual class, 


Demanded Line Items Listed 





We begin the analysis with an examination of the demanded line items included in each 
of the six kits: the 15K, 20K, and 25K RAND-SMAMA experimental kits, the 20K+J kit, the 
TAC kit, and the USAFE dispersal kit. A kit is credited with listing a line item if it contains 
one or more units of that line item, regardless of how many units were demanded. Not all line 
items credited as listed in the kit were necessarily supplied in sufficient quantity to cover the 
squadron's demands fully. 

By dividing the number of line items listed by the appropriate figures for line items 
demanded, we arrive at the percentage of demanded line items which were listed in the various 
kits—-one measure of their degree of coverage. The experimental kits listed 58 to 71 percent 
of the demanded line items. The TAC kit listed 43 percent at L and 54 percent at B, while the 
Corresponding figures for USAFE are 36 percent and 40 percent. 


Demanded Line Items Listed Adjusted by Essentiality-Installability 


Thus far, the analysis has been made in terms of the relation between the numbers of 


line items demanded and the numbers of line items listed. This procedure implies that all 
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line items bear equal weight or importance. In reality, however, some are far more essentiaj 


to the mission of the aircraft than others. Some are not installable at squadron level, and 
should not even be considered as prospects for a kit which presumes only squadron-level 
maintenance capability. Clearly, among the line items demanded, it is more important that 
a flyaway kit include installable items, particularly the ones with higher essentiality. It is not 
sufficient, therefore, to compare total numbers of line items listed when alternative kits are 
being evaluated; the line items listed should be weighted by an essentiality-installability index, 

In carrying out the essentiality-installability analysis, we applied weighting factors 
adopted at the SMAMA conference mentioned earlier. Those line items which were demanded 
but not listed in the Master Parts List had no essentiality-installability factor assigned to them, 
In these instances, the factor 0.5 was thereupon arbitrarily assigned, 0.5 being the mid-point in 
the essentiality-installability range from 0 to 1. 

Table 8 presents figures weighted by essentiality-installability for the percentage of 
demanded line items which were listed in the kits. The high level of the figures for the RAND- 
SMAMA kits is striking. Except for the other-benchstock and non-each classes, the percentage- 
listed figures exceed 70 per cent—much higher than the corresponding figures for the TAC and 
USAFE kits. 

The effect of adding essentiality-installability to the analysis is to increase the percent- 
age-listing figures by 10 to 15 percentage points for the RAND-SMAMA kits, while for the TAC 
and USAFE kits the increase was generally less than 5. Thus, the performance of the RAND- 
SMAMA kit (measured in terms of line items listed) is enhanced when essentiality -installability 
is added to the analysis. This is to be expected, since the RAND-SMAMA computational proce- 
dure takes account of essentiality-installability in a formal manner. 

Needless to say, the entire essentiality-installability analysis depends on the validity of 
the essentiality-installability weights adopted at SMAMA. However, whether or not this factor 
is added to the analysis, the main conclusion is the same: the RAND-SMAMA kits listed more 
of the line items demanded than did either the TAC or USAFE kits. 

Thus far, nothing has been said about differences in performance among the four 
experimental RAND-SMAMA kits. The heavier kits are constructed by adding spare parts to 
the lighter kits; therefore, the 25K kit lists at least as many line items as the 20K kit, the 
20K kit at least as many as the 15K, and the 20K+ J at least as many as the 20K. 

How much support did an additional 5000 or 10, 000 pounds contribute, compared with 
the performance of the 15K kit? Table 8 shows that the 25K kit listed between 3 and 8 percent- 
age points more of the total demanded line items (weighted by essentiality-installability) than 
did the 15K kit. The other benchstock and residual classes experienced the larger increases. 
These figures show that by increasing the weight of the 15K kit 67 percent we increased the 
number of demanded line items listed by 10 to 20 percent. 

Two comments should be added: (1) the performance of the 20K kit lies about midway 
between that of the 15K and 25K kits; (2) the 20K+J kit, weighing 25, 000 pounds, provided 


virtually the same support as the 25K kit in terms of the numbers of line items listed. 
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TABLE 8 
Percentage Of Demanded Line Items Listed 


Adjusted By Essentiality-Installability* 





Categories 
Engine Other F-100D 


Benchstock/Benchstock | Peculiar 





Residual Non-Each 








100 64 86 83 23 
85 63 80 68 29 
86 59 85 71 17 





67 86 87 23 
70 80 78 29 
64 85 79 17 





68 86 91 23 
70 80 82 29 
65 85 84 ay 





67 86 91 23 
70 80 86 29 
64 85 86 17 





38 25 58 41 
58 40 54 52 
39 29 93 39 





28 38 39 41 
32 60 49 52 
26 44 42 20 


aor (Aa @el eae 8e ll eerie wrinayr © 
































“Table 8 is calculated as follows: The essentiality-installability (E-I) rating of each line item 
demanded is noted down and summed within the appropriate categories. This yields the number 
of line items demanded, by category, weighted by E-I. Similarly, the sum of the line items 
listed, by category, and weighted by E-I, is calculated. Then each of the latter set of numbers 
is divided by its counterpart in the former set. This yields the percentage of demanded line 
items which are listed, for each of the categories in the table, after adjustment for E-I. 


It is also interesting that the difference between the 15K and 25K kits, in the percentage of 
demanded line items listed, is less when essentiality-installability is added to the analysis. 
This is something we would expect, because some of the demanded line items with low essentiality - 
installability, which failed to be listed in the 15K kit, enter the heavier kits as kit-weight is in- 
creased. The average essentiality-installability per line item listed (among those demanded) 


in the 25K kit is less than that for the 15K kit (see Table 9). Thus the relative improvement in 
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coverage with the heavier kits must be less when essentiality-installability is taken into ACCount 


in the analysis. 


TABLE 9 
Average Essentiality-Installability 


Per Line Item Listed 





15K 25K 





B B 





























| 0-6 





Demanded Line Items Fully Covered 





Thus far, we have evaluated the kits in terms of the number of line items listed. It has 
already been pointed out that a line item reported as "listed" is not always supplied in sufficient 
units to meet its unit demand fully. A count of the number of line items listed is a measure of 
the breadth of kit coverage, but not of the depth. Since the RAND-SMAMA kits contain about 
ten times as many line items as the TAC or USAFE kits, a test which measures breadth only 
is likely to be too heavily in favor of the RAND-SMAMA kits. We therefore pass to another 
measure of kit adequacy: the number of line items available in sufficient quantity to meet the 
demand fully. 

Tabulating the number of line items with 100-percent coverage introduces depth of 
stockage into the analysis. Under this procedure, if 15 units of a given item were demanded, 
a kit received credit only if it contained at least the requested 15. 

The RAND-SMAMA kits fully covered between 55 and 63 percent of L's line-item 
demand, whereas TAC and USAFE covered 38 and 35 percent, respectively. For B's demand, 
the RAND-SMAMA coverage ranged from 31 to 43 percent, with 46 percent for TAC and 38 
for USAFE. 

For Squadron L, the findings parallel those for the percentage of demanded line items 
listed (Table 8). The RAND-SMAMA kits supplied more line items with 100-percent coverage 
than did the TAC kit, while the TAC kit supplied more than did the USAFE kit. For B, the 
findings followed a different pattern. In terms of the total number of line items fully covered, 
the kits ranked in the following descending order: TAC, 20K+J, 25K, USAFE, 20K, and 15K. 
No uniform pattern emerges for the individual classes. While TAC performed better for the 
two benchstock classes, the RAND-SMAMA kits were ahead in the F-100D peculiar and 
residual classes. The relative performance of the USAFE kit varied from class to class. The 
findings for C tend to parallel those for L, since L contributed a larger share of C's line-item 
consumption than did B. 


Why did the RAND-SMAMA kits compare unfavorably with the TAC kit for the bench- 


stock classes? One distinction between the TAC and USAFE kits on the one hand and the RAND 


SMAMA kits on the other is in the depth in units provided for the benchstock line items listed 
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in each of the kits. In general, the TAC and USAFE kits contain many more units than the 
RAND-SMAMA kits for the same line items. Squadron B demanded many of the benchstock 
line items in relatively large quantities; because of the TAC kit's greater depth it succeeded 
in furnishing more of these, with 100 percent coverage, than did the RAND-SMAMA kits. 

The weakness of the RAND-SMAMA kits in the engine-benchstock and other-benchstock 
classes is due primarily to inadequate input data. Benchstock consumption data generated at 


Langley and Cannon AFB's, and fed into the RAND computational procedure, appear to have 


been greatly understated. Consequently, many of the benchstock line items, although listed 


inthe RAND-SMAMA kits, were not furnished in sufficient unit quantities to meet the demand 
fully. 

The most striking example of under-reported benchstock consumption at Langley and 
Cannon AFB's is a tabwasher, Stock No. 0245-5310-305-7413 (AF No. 0245-261696). Every 
50-hour engine periodic consumes 16 of these tabwashers. Personnel of the 413th Tactical 
Fighter Wing at George AFB report that average monthly consumption per F-100D squadron 
amounts to several hundred. In sharp contrast, the Langley-Cannon consumption report for 
the tabwasher averaged 22 per squadron-month. Given this low figure, the RAND procedure 
authorized only 41 units for stockage in the 15K kit——far short of typical demand. The TAC 
and USAFE kits, evidently benefiting from superior consumption information, authorized 240 
and 280 units, respectively. The case illustrates our point——that understated input data caused 
the RAND-SMAMA kits’ inadequate coverage of the demand for many benchstock items—and 
suggests that different procedures should be adopted in estimating benchstock consumption. 

For reasons already mentioned, it is desirable to add essentiality-installability factors 
tothe analysis. Table 10 shows the percentages of line items fully covered, weighted by 
these factors. The main conclusions are not affected by adding essentiality-installability to 
the analysis. For L, the relative superiority of the RAND-SMAMA kits is increased, since 
the addition of this factor to the analysis adds 15 percentage points to their percentage coverage 
while it adds nothing to TAC's percentage coverage. For B, the relative superiority of the 
TAC kit persists. 


Summary of the Findings for Demanded Line Items Fully Covered 





Earlier in the analysis it was clearly demonstrated that the RAND-SMAMA experimental 
kits listed considerably more of the demanded line items than did the TAC and USAFE kits and 
thus demonstrated greater breadth of coverage. We then added the depth criterion—line items 
listed in sufficient quantities to satisfy fully the demands generated at B and L. 

For Squadron L, the findings clearly establish the greater effectiveness of all the 
RAND-SMAMA kits. The TAC kit provided somewhat more coverage than did the USAFE kit. 
For Squadron C, also, the RAND-SMAMA kits compared favorably with the TAC and USAFE 
kits. The difference in performance was not so great as in the case of L, however. 

At Squadron B, there is a reversal of the trend in the findings thus far presented. In 
the two benchstock classes, TAC fully covered more line items than did any of the RAND-SMAMA 
kits. Asa result, the TAC kit outperformed the RAND-SMAMA kits for B as a whole. 
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TABLE 10 
Percentage Of Demanded Line Items With 100 Per Cent Coverage 
Adjusted By Essentiality-Installability 





Categories * 





Engine Other F-100D 


Benchstock |Benchstock | Peculiar Residual 








100 56 76 75 
12 41 60 56 
15 44 72 54 





58 76 83 
42 60 74 
46 72 67 





58 76 91 
42 60 82 
46 72 79 





62 76 87 
14 43 60 82 
17 49 72 717 





77 37 25 46 
60 52 40 48 
61 36 29 42 





77 28 38 35 
40 29 40 49 
Cc 42 24 39 35 


*The non-each category is omitted from tables involving unit stockage 
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With some qualifications, we may conclude that the performance of the RAND-SMAMA 
kits was somewhat superior to that of the TAC kit, when performance is measured in terms of 
line items fully covered. This conclusion is based on their clear-cut superiority at L and C. 

On the other hand, it does not follow that the RAND-SMAMA kits performed satisfactor- 
ily. Their performance in the benchstock classes is poor in contrast with the fair to satisfactory 
performance in the F-100D-peculiar and residual classes. The reason for the poor performance 
in the benchstock classes has already been mentioned and is one of the major conclusions of this 
test——that a new method for estimating benchstock consumption is required. That the RAND- 
SMAMA kits performed as well as they did, despite the inadequate input data, is a point worth 
noting. 


Percentage of Listed Line Items with 100-Percent Coverage 





Earlier in this paper, it was noted that the percentage of demanded line items with 


100-percent coverage can be divided into two components, the percentage of line items listed 
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and of listed line items fully covered. This is shown by the following identity: 


Line Items Fully Covered _ Line Items Listed x 
Line Items Demanded Line Items Demanded 








Line Items Fully Covered 
Line Items Listed 





Having already examined two of the variables in the above identity, we now briefly turn 
to the third, the percentage of the listed line items among those demanded, of which enough 


units were supplied to satisfy the demand fully. This variable is a measure of the depth- 


performance of the kits for only those demanded line items which were listed by the kit in 


question. 

Table 11 shows the percentages of listed line items with 100-percent coverage adjusted 
by essentiality-installability. The table clearly indicates that by this measure the USAFE kit 
outperforms the others. For L and B, more than 90 percent of the line items listed in the 
USAFE kit were stocked in sufficient units to satisfy the consumption requirements fully. We 
alluded earlier to the relatively small number of the demanded line items which the USAFE kit 
listed. When it does list a line item, however, it generally stocks it deeply enough to meet 
the full demand better than 90 percent of the time. 

The TAC kit shares these characteristics of the USAFE kit. More than 80 percent of 
the demanded line items which were listed in the TAC kit were generally stocked deeply enough 
to satisfy the demand fully. Comparing the two, however, we may conclude that although the 
TAC kit is slightly inferior in depth of coverage its superiority in the number of listed line 
items more than compensates for its lesser depth; this conclusion is borne out by the TAC kit's 
superior performance in terms of demanded line items with 100-percent coverage. 

In looking at the RAND-SMAMA kit data in Table 11, we must pay particular attention 
to the low levels of the B figures for the two benchstock classes. For example, in the 25K kit, 
note that for B only 14 percent of the engine-benchstock listed line items were stocked deeply 
enough to meet the demand. Note also that for the F-100D-peculiar and residual classes, 
which do not include benchstock, the figures are quite high, somewhat closer to the corresponding 
TAC and USAFE figures. Thus, it is primarily in the benchstock classes that the RAND-SMAMA 
kits failed to stock in sufficient depth. This is consistent with our previous evidence that bench- 
stock consumption data fed into the RAND-SMAMA computational procedure were greatly under- 
reported. On the other hand, it should be noted that the Product Improvement Program (PIP), 
employed as a data source at Langley and Cannon AFB's, apparently did succeed in generating 


reliable consumption information for the non-benchstock items. 


Analysis of Shortages—— Line Items Listed 





We now pass to an analysis of some of the factors responsible for diminishing the 
performance of the RAND-SMAMA kits. Under-reporting of benchstock consumption is one to 
which we have already referred. Another is an incomplete Master Parts List (MPL), on which 


we now focus our attention. 





TABLE 11 
Percentage Of Listed Line Items With 100-Percent Coverage 
Adjusted By Essentiality-Installability 





Categories 


Sqdn} Engine Other F-100D 
Benchstock Benchstock | Peculiar 





Residual 








100 88 88 91 
14 66 75 82 
18 75 85 77 





87 88 95 
60 75 95 
71 85 85 








86 88 
60 | 75 
71 85 





92 88 
61 | 75 
76 | 85 








98 
89 
92 





99 
89 
93 
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One of the initial steps in the RAND procedure is to prepare an MPL. Theoretically, it 
lists all replaceable parts on the aircraft by stock number; from it alone, the RAND computa- 
tional procedure selects line items for admission to the kit. 

Needless to say, a complete and accurate MPL is necessary for good kit design but is 
hard to acquire in practice; and gaps in the MPL leave parallel gaps in the flyaway kit. To 
what extent are the shortcomings in the RAND-SMAMA kits attributable to an incomplete 
F-100D MPL? 

Table 12 presents figures on the number of demanded line items not listed in the RAND- 
SMAMA kits (Column 1) and on the number omitted from the MPL (Column 2). Of the line items 
not listed, Column 3 indicates that between 50 and 84 percent (depending on the kit and squadro 
taken) were not in the MPL. Thus more than half the unlisted line items had not been considerel 
as candidates for the kits. 
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TABLE 12 
Analysis Of Line Item Shortages 


(1) | (3) (4) (5) 





Kit isqdn Number of | Number of | Percentage of Percentage of | Percentage of 
Line Items Line Items/|Not Listed Line |Candidate Line | Candidate Line 
Not Listed Notin MPL Items WhichWere| Items Listed Items Listed 

| Not in MPL Excluding Those 

With 0. 001 E-I 


4 
+ 











50 86 
63 88 
57 85 








57 | 93 
71 95 
66 93 











61 | 95 
84 97 
73 95 














The fourth column shows a measure of the potential performance of the RAND-SMAMA 
computational procedure, given a complete MPL. It tabulates, by percentage, the demanded 
line items which were listed in the MPL and included in the RAND-SMAMA kits. These figures 
are derived in the following manner, with the 25K kit at Squadron C taken as an example. 

Of the 226 line items demanded at C, 172 appeared in the MPL. Of these 172, in turn, 152 
(88 percent) were listed in the 25K kit. This suggests that had the MPL been complete, the 
25K kit might have listed 88 percent of C's demand (instead of the 67 percent it actually 
listed. ) - It is evident from Column 4 that the RAND-SMAMA kits succeeded in listing a 
wide range of the demanded candidate line items. 

When essentiality-installability is superimposed on the analysis, the figures are even 
more impressive. The fifth column in Table 12 shows the percentage of line items listed in 
the kits among those candidates with greater than 0. 001 essentiality-installability. The 
exceptionally high level of the figures in Column 5——those for the 20K and 25K kits are all 
between 93 and 97 percent——establishes the great power and potential of the RAND computa- 
tional procedure in providing coverage over a wide range of line items. 

The above findings substantiate the following important conclusion: the RAND computa- 
tional procedure, in conjunction with a complete and accurate MPL, with reliable essentiality- 


installability coding, will list an extremely high percentage of the line items demanded by a 


The 88-percent figure may be slightly overstated. If the MPL had indeed been complete, 
Some new line items could have become part of the kit and might have crowded out some of 
the present line items, including some of the 152 for which the kit received credit. 
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squadron and having greater than0.001 essentiality-installability. Moreover, despite the ip- 
completeness of the F-100D MPL, the breadth of coverage of the RAND-SMAMA kits was 
quite good, ranging from 71 to 81 percent (see Table 8). 


Analysis of Shortages——Demanded Line Items with 100-Percent Coverage 





While the RAND-SMAMA kits proved successful in listing a relatively large share of 
the line items demanded, their performance in terms of ’‘ne items listed with 100 percent 
coverage was not satisfactory. This remark should be qualified in that the ''100-percent 
coverage" performance of the kits was satisfactory for the F-100D-peculiar and residual 
classes, especially after essentiality-installability factors are superimposed on the analysis, 
However, it was exceedingly poor for the two benchstock classes. 

To what extent are the shortcomings of the kits in providing line items with 100-percey 
coverage due to an incomplete MPL? Table 13 indicates that certain gaps exist even if the 
effect of an incomplete MPL is removed and the 0. 001 essentiality-installability items are 
isolated from the analysis. 

Table 13 also confirms previous findings: while the coverage on the F-100D-peculiar 
and residual classes is fair, that for the benchstock classes at B continues to be poor. Clear, 
the poor showing of the benchstock classes is not due to inadequacies in the MPL; rather, as 
noted, it stems from under-reported benchstock consumption at Langley and Cannon AFB's— 
the sources of the original data which were subsequently used in the RAND computational 
procedure. !! 


Summary of Line-Item Analysis 





Having concluded our analysis of the flyaway kits by line items, we may profitably list 
some of the main conclusions: 

(1) The RAND-SMAMA kits listed more demanded line items than the TAC kit, which 
in turn listed more than the USAFE kit. 

(2) In terms of the number of line items listed, a measure of breadth of coverage, the 
performance of the RAND-SMAMA kits is fair; had the Master Parts List been complete, their 
coverage would have been excellent. 

(3) In terms of the number of line items listed and supplied in sufficient units to meet 
the demand fully, the performance of all kits was poor, with the heavier two of the RAND- 
SMAMA kits (the 25K and 20K+ J) showing a slight over-all edge over the TAC kit, which in 
turn provided more coverage than the USAFE kit. 

(4) The performance of the RAND-SMAMA kits, measured in terms of line items 
supplied with 100-percent coverage, was particularly poor for benchstock line items. 

(5) Point (4) above is attributable to serious under-reporting of benchstock consump- 
tion at Langley and Cannon AFB's; on the other hand, the PIP failure-reporting program which 


‘rhe reader may wonder about the 100 percent figure for the engine-benchstock class at L. 
At L there was under-reporting of engine-benchstock consumption, especially of engine 
50-hour periodic consumption, and this allowed the kit coverage to appear very good. B's 
reported benchstock consumption is more typical than L's. 
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TABLE 13a 
Number Of Demanded Line Items With 100-Percent Coverage Among Those 
Candidates With Greater Than 0.001 Essentiality-Installability 


15K 20K 25K 





a 





Categories 
C L B c L B 


Engine Benchstock 6 - 6 6 os 6 6 = 6 
Other Benchstock 29 9 31 32 10 35 32} 10 | 35 
F-100D Peculiar 10 3 13 10 3 13 10 3 13 
Residual 25 16 30 27 21 36 29 | 23 41 
TOTAL 70 32 80 75 38 90 77 | 40 | 95 












































‘ TABLE 13b 
Percentage Of Demanded Line Items With 100-Percent Coverage Among Those 
Candidates With Greater Than 0.001 Essentiality-Installability 





15K 20K 25K 





Categories 
B Cc B Cc B Cc 


Engine Benchstock 16 27 16 27 16 27 
Other Benchstock 64 45 53 71 50 59 71} 50] 59 
F-100D Peculiar 77 75 76 77 75 76 77| 75 | 76 
Residual 78 70 65 84 91 78 91 89 

TOTAL 73 44 54 78 53 60 80} 56 | 64 












































was applied at Langley and Cannon AFB's to non-benchstock line items appears to have gener- 
ated fairly accurate consumption data. 


Analysis in Terms of Units Demanded and Supplied 





In the preceding sections, the flyaway kits have been evaluated in terms of line items. 

It is also useful to review briefly the findings in terms of units demanded and supplied. Whereas 
the number of line items consumed represents a total of different (unique) parts, the number of 
units consumed represents a total number of parts used, consisting partly of repetitive de- 

mands for the same (unique) part. The unit-analysis approach emphasizes depth and neglects 
breadth in evaluating kits. No attention is focused on the range of line items underlying the 

unit figures. 

As previously discussed, the unit analysis omits the non-each class from consideration, 
because it is misleading to refer to the number of "units" consumed of such bulk items or 
continuous items as oil, grease, or wire. 

Figure 1 demonstrates that a small proportion of the line items demanded accounts for 
alarge proportion of units demanded. The sharply rising curve indicates that 20 percent of the 
demanded line items accounted for 64 percent of the demanded units; thus the remaining 80 
percent of the line items accounted for only 36 percent of the units. 

It is important to bear in mind this unevenness of unit distribution. Because of it, the 


results of the unit analysis will be greatly influenced by a small number of high-demand line 


items. These items are mainly in the engine-benchstock class and, to a lesser extent, in the 








other-benchstock class. Thus, the unit perform. 
90 


ance of the kits will depend heavily on how they 


S80 satisfy benchstock requirements. 


70 


oa Units Demanded 





él Now we turn to the findings of the analysis 


“ by units. Table 14 presents the demand data. 


ai Note that while L demanded more line items, B's 


PERCENTAGE OF UNITS DEMANDED 


ool unit-demand exceeded that of L (547 units againg 


0 395). This is due mainly to the heavy consump- 








ie} 








bo py eS ES SES en tion of engine benchstock, part of which was 
PERCENTAGE OF LINE ITEMS DEMANDED generated by periodic engine inspections. (It 
Figure 1 - Unit distribution for will be recalled that L failed to report consump- 
squadron C (exclusive of non-each 


tion of parts in periodics.) For both B and L, 
class) 


the benchstock classes accounted for a very large 
proportion of the units consumed. Many of these 

are units of high essentiality-installability. Thus one point is obvious: adequate stockage of 
benchstock items is crucial. Since these items are generally inexpensive and light in weight, 


an inadequate supply of benchstock is a clear indication of shortcomings in kit design. 


TABLE 14 
Number of Units Demanded 





Line-Item Class 


Squadron Demand 





L B Cc 





Engine benchstock 
Other benchstock 
F-100D peculiar 


Residual 


23 
155 
36 9 
56 56 








Total 


395 

















TABLE 15 
Number of Units Demanded, Adjusted 
By Essentiality-Installability 





Squadron Demand 





Line-Item Class 


L B Cc 





Engine benchstock 
Other benchstock 
F-100D peculiar 


Residual 


20. 7 | 308. 1/328. 8 
82.6] 70.1)152.7 
27.7 7.0) 34.7 
41.5| 43.2] 84.7 








Total 





172. 5 | 428. 4} 600. 9 














Units Demanded Adjusted by Essentiality- 

Installability 

We derive Table 15 through weighting the 
unit demand figures of Table 14 by the SMAMA 
essentiality-installability factors. 





The average 
essentiality-installability per unit demanded at 
L is 0. 44 compared with 0.78 at B. B's com- 
paratively large consumption of engine benchstoci, 
much of which is of high essentiality-installability 
accounts for its higher over-all average. Because 
of B's higher average essentiality-installability, 
the difference in unit demand between B and Lis 
widened when this factor is taken into account. 
Weighting by essentiality-installability results 
in a decline from 547 to 428.4 in B's demand, 


compared with L’s sharp fall from 395 to 172.5. 


Percentage of Units Supplied 





How successful were the flyaway kits in 
satisfying the unit demands? The data on per- 


centages of units supplied are presented by kit, 





C thar 
For L 


insigh 
kits s 
Morec 
Satisf 
cover 
class, 


assur 





chstock, 
lability, 
Because 
vility, 
d Lis 
unt. 
ults 
ad, 
72.5. 


DESIGN, TEST, AND EVALUATION OF A FLYAWAY KIT 133 


class, and squadron in Tables 16 (without adjustment for essentiality-installability) and 17 (with 
adjustment for essentiality-installability). The most striking finding disclosed by these tables 


is the generally low level of performance of each of the kits tested. 


TABLE 16 
Percentage Of Demanded Units Supplied 





Categories 


Engine Other F-100D 
Benchstock |Benchstock Peculiar 





Residual 











100 27 44 75 
31 28 44 
31 27 44 61 





30 44 79 
30 44 66 
30 44 67 





31 47 82 
32 44 70 
31 47 72 





36 44 82 
33 44 77 
34 44 78 





s6UTtéiaS 55 
38 22 45 
38 13 43 
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34 58 39 
17 33 39 
28 53 38 
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As Table 16 indicates, the TAC kit furnished more of the total unit demands for B and 
C than did the USAFE kit, which in turn provided more units than did the RAND-SMAMA kits. 

For L, there were only minor differences among the kits. 

A look at relative kit performance for the individual classes yields some interesting 
insights. For the residual and F-100D classes, and for each of the squadrons, the RAND-SMAMA 
kits supplied considerably larger percentages of units than did either the TAC or USAFE kits. 
Moreover, when essentiality-installability weights are attached, these figures reach quite 
Satisfactory levels. In the other-benchstock class, all of the kits did poorly, none reaching 


coverage figures beyond 38 percent (see Table 16). There remains only the engine-benchstock 


tlass. Here the superior performance of the TAC and USAFE kits at B was great enough to 


assure their superiority in terms of the total units demanded. 





confid 


Note that Table 17, which incorporates the essentiality-installability adjustment, does howev 


not change the basic findings of the unit analysis. 


Thus, to repeat a conclusion reached earlier, the poor performance of the RAND-SMAM 


The M 
kits in satisfying benchstock demands —-especially for engine benchstock—marred what were 


otherwise quite satisfactory F-100D flyaway-kit test results for the RAND-SMAMA kits. Clearly 


a most pressing need is to establish and utilize a data-collection system which will provide 


better 


Maste 


needed information on benchstock consumption. progr’ 


squad) 
TABLE 17 
Percentage Of Demanded Units Supplied figure 


Adjusted By Essentiality-Installability the te: 





Categories 
Kit Engine Other F-100D 
: Residual _— 


Benchstock |Benchstock | Peculiar 
100 27 55 85 54 BS Repor 


34 39 57 69 39 
32 32 56 70 39 tion de 


it mus 
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43 57 84 43 
35 58 84 44 
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REMAINING PROBLEMS that in 
The Air Force has already decided to adopt the RAND method for designing flyaway kits benchs 
and has revised AF Manual 67-1 accordingly. The results of the F-100D test described 
in this paper as well as previous test results for the F-86H (described in RM-2062) and 


for the B-47 (described in RM-1490) are encouraging reassurances that the Air Force's 
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confidence was not misplaced. Some problems in the RAND method still remain unsolved, 


however, and merit further attention. 


The Master Parts List 

Given the acceptance of the RAND method, the key to better flyaway kits is to obtain 
better input data. The F-100D test revealed, first of all, that the problem of compiling complete 
Master Parts Lists remains a thorny one. Even so, compared with the F-86H test, considerable 
progress has been made: The F-86H MPL contained only 5375 candidate line items installable at 
squadron level, but the F-100D MPL contained 20, 663. Nevertheless, even this large F-100D 
figure is little better than a consolation prize, since 54 of the 226 line items demanded during 
_ the test period in Germany were not to be found in the MPL. The MPL must not only be complete, 
it must also contain accurate information on unit weight, unit pack, unit cost, stock number, 


and nomenclature. It should also identify interchangeable parts. 


Reporting Of Consumption Data 

The major problem area disclosed by the F-100D test is in collecting reliable consump- 
tion data to use in calculating expected demand rates. SMAMA has recommended that these 
data should be collected through the Weapon Systems Management procedures found in Volume 
20 of AFM 67-1. These data would be generated from squadron requisitions for spare parts. 
In this respect, the recommendation is a sharp departure from the USAF PIP system used in 
collecting consumption data for the F-100D flyaway-kit project. Under the PIP system, con- 
sumption data come from the primary source——the mechanics who use the parts. 

It is this author's tentative surmise that the PIP program, when monitored, is likely 
to generate more reliable data than those gathered through the AFM procedures. It seems 
logical that a using source will produce true consumption data——more so than will sources at 
one or two removes. However, the PIP system must be policed to be effective, and may 
therefore be more costly than the AFM methods, unless they too are found to require extensive 
policing. This may be a factor to consider in weighing the two alternatives. 


The results of the F-100D test suggest that, for non-benchstock line items, reporting 





of consumption at Langley and Cannon AFB's was fairly reliable. For this reason we urge that 
further research be done before the PIP method is abandoned as a data-collection scheme. 

The F-100D test also indicated that the major shortcoming of the experimental kits was 
their inadequate supply of benchstock. This was primarily due to under-reported benchstock 
consumption at Langley and Cannon AFB's. (It should be noted that the PIP system was not 
utilized in reporting benchstock consumption. ) The method used—comparing beginning and 
ending inventories with benchstock requisition data—proved highly unsuccessful. It is urged 


that in the course of future flyaway-kit work, particular care be taken to collect accurate 


benchstock data, whether through a well-policed PIP system or through some other system. 
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The Relevancy Of Peacetime Consumption Data 

A somewhat different problem emerges from the fact that consumption data were cg}. 
lected under peacetime conditions to develop a suitable wartime kit. Can we expect the same 
pattern of failures in both combat and flight training? Are maintenance activities to be the 
same in wartime and peacetime? If the answers to these questions are negative, more regeay, 


will be required to tailor kits specifically for combat use. 


The Essentiality-Installability Problem 
The RAND method requires that a conference be convened prior to kit computation in 


order to assess the essentiality and installability of each candidate line item. The assignmet & INTROL 
of an installability index depends on what level of maintenance is assumed. To make an accun 


' 


determination for as many as 25, 000 line items may prove a difficult problem; it is even more & e lis 
anc 


difficult to estimate the essentiality of many line items. How many categories of essentiality 


as rang 

should be designated? What numerical factors should be assigned to each of the categories? §& pene 

Such questions may merit further research. : 

of that 

» formant 

Managing The Flyaway Kits siti 
A final question relates to managing the flyaway kits. The 25K RAND-SMAMA kit for 


the F-100D contained 17, 813 line items, compared with about 2200 line items in the TAC kit. 
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If the F-100D MPL had been complete, more line items would have entered the kit, and we do ‘inion 
not know yet whether or not managing a large number of line items will pose a serious problem & 

in peace or war. If the kits prove unwieldy, it still may be possible to reduce the number of The sig 


line items by including higher level-of-assembly parts for some of the "bits and pieces," by suggest 


weeding out superfluous substitute and interchangeable items, and, wherever possible, aggregu general 
ing hardware items into small repair-and-installation kits pertaining to particular assemblies. 


When some of these problems are solved, it is apparent from the F-100D results that the allo 
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SIMULATIONS OF ALTERNATIVE ALLOWANCE LIST POLICIES *t 
Henry Solomon 
The George Washington University 


and 
Marvin Denicoff 


USN "ureau of Supplies and Accounts 


| INTRODUCTION 


This report describes a simulation for evaluating a new method of determining allow- 
ance lists for naval vessels, i.e., a list of the items and quantities of each, commonly known 
as range and depth, which constitute the stock of material carried aboard a ship in direct sup- 
port of the ship's installed equipments. The method is essentially a mathematical computation 
of that list of items which will maximize the ship's capability to meet demands during per- 
formance of operational missions. It includes a consideration of the following factors: endur- 
ance loading, resupply policies, period of support, criteria for selecting the range and depth 
of insurance items, and storage limitations of ships. It also requires specific data on such 
item characteristics as usage rates, fluctuations in usage rates, population of installed parts 
and components, unit cube, and military worth. 

Inthis report results of thefirst Allowance List Test Program simulation are presented. 
The significance of these results is discussed, and some important tasks for the future are 
suggested. The center of interest is the allowance list or shipboard inventory problem. The 
general orientation of the simulation appears in | 2] . 

There is now sufficient evidence from empirical work to demonstrate that a solution of 
the allowance list problem has been impeded by two factors: inadequate statements of the 
problem and unsuitable methodology. A general discussion of these factors is given in [ 2, 
pp. 2-6]. However, it should be stated here that the principal problem is that previously sug- 
gested methodology assumes that shipboard usage of spare parts can be described by one of the 
known statistical distributions. This, however, is not the case since usage is extremely low 
and sporadic. This has been clearly evidenced by every attempt at empirical experiments. It 
may also be seen by the small number of items used during the time period of this simulation 
4 compared with the total number of items which had an opportunity to be used, i.e., deemed 
wearable and replaceable. This is an important conclusion but one of a negative kind. It now 
remains to be positive and to define the problem adequately while at the same time evolving 


a 
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fitting methodology. This is the goal of the research program and the purpose of numerica 
simulation, both for the present and some time in the future. On the basis of empirical info. 
mation it is hoped to derive a relevant quantitative formulation of the problem which permits, 
quantitative solution. 

Even before the final goal of ALTP is achieved, it would appear that some of the interiy 
results can be of immediate benefit to the Navy. In fact, even at this early stage, there are 
some significant possibilities for improvements over present procedures which stem largely 


from the "military-worth" procedures employed in ALTP. 


GENERAL COMMENTS ON THE NATURE OF THE SIMULATION 

Various characteristics ascribed to the allowance list problem were discussed in [ 2}. 
Two aspects of the problem being considered in ALTP are the "initial stocking" problem and 
the "reorder and resupply" problem. The simulation described in this report is concerned 
only with the initial stocking problem. This is not because the reorder problem is unimporta 
or uninteresting. The principal reason for restricting the simulation to initial stocking is tha 
it appeared to be a logical first step. Some very basic and important outputs were desired 
which required only an examination of the initial stocking problem. A second important reasm 
for restricting the nature of the simulation was to permit the proper evaluation of a large 
amount of computer outputs. 

The simulation employed may be termed a "machine simulation" as contrasted witha 
"man-machine simulation." Data pertaining to one submarine were utilized. They consisted 
of approximately 32,000 part applications. The exact data will be described in the next sectioi 
For the present it should be noted that no sampling was performed of the parts pertaining to tie 
submarine. The sample may be considered to be the one submarine with its entire population 
of installed parts. 

Essentially the simulation was to stock the vessel for some future period by using vari- 
ous stocking policies and utilizing historical data. For the "past" as well as the "future" peri- 
ods actual usage data were employed. In no case was hypothetical usage introduced. 

The simulation is concerned with testing the effectiveness of various stocking policies 
which have been developed under ALTP. In order to make these tests, the USS TIRU (SS 416) 
was selected as the sample or test ship. 

The study covered the period of April 1952 through June 1956. There were two inter- 
overhaul periods during this time, each of approximately 22-month duration. The general 
scheme for testing the effectiveness of each of the stocking policies is as follows. 

Various sample allowance lists, each reflective of one of the stocking policies devised 
in the Project, have been constructed for USS TIRU. The computation of item allowance qua 
tities under each of the policies was based on military-worth data and usage data collected 
during one inter-overhaul period. 

The effectiveness of a particular policy was evaluated by comparing the sample allovw- 
ance list (based on one inter-overhaul period) with the actual usage which occured in the sub- 


sequent inter-overhaul period. Shortage counts were then evaluated to provide a basis 
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for measuring how well each of the policies performed in terms of its stated 


objectives - 


It should be noted that TIRU's actual allowance list was also compared with usage gen- 


| erated during a particular inter-overhaul period to provide a basis for comparing current 


allowance list methodology with the proposed formulations. 


DATA INCLUDED FOR SIMULATION 
Usage Data 


Six years of usage data pertaining to the sample submarine were utilized. These data 


" were collected under the Korean Data Collection Program. The data represent collection from 


universal data sources, i.e., usage data generated by the sample ship itself plus all other ac- 
tivities using material on account of the sample ship (shipyards, tenders, etc.). The data are 
described in [1,3]. 


Population Data! 

Population data were furnished to the Project by the various SDCP's. For each part 
(stock number) these data included: the number of times it is installed on any one equipment, 
the number of times it is installed over all its equipment applications, and the total number of 


times it is installed on the vessel. 


Military-Worth Data 
For each part application, the worth of the part to the equipment in which it is installed 


is given as well as the worth of that equipment to the mission of the vessel. These data are 
described in [ 4] . 


Cube Data 


The unit cube of each part installed on the vessel was employed. These data were fur- 
tished to the Project by the various SDCP's 


Shipboard Stowage Capacity Data 

In this case USS TIRU was solicited for information on the spaces that were available 
for the stowage of spare parts. TIRU was instructed to estimate its capacity based not simply 
mits designed capacity but on its actual capacity, taking into account the emergency stowage 
spaces that are traditionally used on submarines. This information was forwarded to the Proj- 
ect and used in the test program. 


Population was computed ona "replacement unit'' basis, e.g., if in the case of bearing ''"X" 
rmotor ''Y, '' bearing ''X''is required to be replaced in units of 4, the population will be con- 
sidered in terms of the number of "units of 4" which are installed. Each "replacement unit" 
'$counted as a population of 1. 
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Allowance Lists 
The actual allowance lists for the time periods under consideration were employed jy 


provide a basis of comparison with ALTP formulations. 


BASIC FORMULATION 

The formulation can be described as a priority loading system. The first items cop. 
sidered for loading are those having high military worth. This is called the insurance ley. 
The total range of high-worth items (installable by the ship's force) is stocked independent of 
past usage. The depth to be loaded is based on the item population. The Project has employe 
two of several possible plans for determining this depth. In one case, the square root of the 
item's population would be stocked. Another possibility here is to load a quantity of one of 
each high-military-worth item regardless of population. Cubes of items assigned to the load 
are aggregated and compared with the total space available so that, at all times, there is 
awareness of the total space being occupied by the loaded items and the space still available 
be filled. 

After all of the high-worth items had been stocked in keeping with criteria established 
for the insurance level, the formulation would attack its second interest, that of stocking su- 
ficient quantities of all items (high and low worth) for the full endurance period. Items stock 
in this endurance level would be based on observed usage and usage variance. Where a high- 
worth item had been previously loaded on the ship in the first priority of stocking but showed: 
zero usage rate, no additional quantity of this item would be stocked. However, if that item 
had been stocked because it had high worth and also showed a usage rate, additional quantities 
of the item would be stocked in accordance with the usage rate. Low-worth items would be 
stocked strictly in accordance with their usage rates. Items which have both low worth and 
zero usage would not be stocked under this formulation. 

The insurance level is referred to as Round 1 of stocking. The endurance level is re- 


ferred to as Round 2 of stocking. A more comprehensive description of the ALTP formulatio 
appears in| 2]. 


RESULTS 
A Measurement of the Severity of the Shipboard Storage Limitation 

Introduction 

An important aspect of the simulations was concerned with obtaining information on the 
severity of the shipboard storage limitation. Answers to such questions as the following wert 
desired: Is it feasible to load all items of high military worth? Does the cube of items used 
during an inter-overhaul period exceed the shipboard storage limitation? Is it possible to loa 
all items of high and low military worth in sufficient depth to satisfy demands (usage) for the 
entire inter-overhaul period? 

Answers to the foregoing questions are of considerable value in establishing allowant 


list policy, and in obtaining insights into the resupply and distribution problems for the entire 
supply system. 
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An Allowance List Model 


In order to test the severity of the storage limitation, an allowance list model which 


) maximized on-board material assignments was constructed. This model, purposely designed 


: with extreme assumptions, has the following aspects: 


(a) All items necessary to the operation of high-worth equipments (independent of 


> whether or not jury-rigging, on-board manufacture, or cannibalization was feasible) were con- 


sidered to have high worth. 


(b) For items with multiple equipment applications, the military worth of the item was 


related to that equipment application to which the highest worth had been assigned. Thus, for 
' example, an item having five equipment applications, only one of which had high military worth, 


| would for all five applications take the military worth of its single high-worth application. 


(c) The square root formula was employed to establish the depth of high-worth items. 
Inthis particular model, the formula was applied to the total population of the item rather than 
being limited to that portion of the population related to high-worth equipments. For example, 
ifa part had five equipment applications, only one of which had high worth, the square root of 
the item population for all five equipments was used to determine the quantity of the item to be 
stocked (depth) . 

(d) Usage data from all data sources were employed. This means that, in addition to 


the ship's own usage, uSage by Shipyards, tenders, etc., on account of the ship was included 


' inthe formulation. For sources other than the ship itself, alteration usage as well as repair 


usage was utilized. 
Considerations 


(a) The actual storage constraint for technical spare parts of the sample ship, USS 


| TIRU (SS 416), was 780 cubic feet. 


(b) The formulation included technical spares of all cognizances. 

Discussion 

The results of the simulation for testing the severity of the storage limitation are given 
inTable 1. A discussion, by cognizance, follows. 

Cog G Material. The cube of Cog G technical material stocked in Round 1 is small. 
This is principally due to the relatively few number of G items which were assigned a high mili- 
laryworth. The cube of the G item usage (R2 and R*2), while much larger than the other 
cogs, is not surprising when it is recalled that the formulation includes shipyard and tender 
usage for the sample ship as well as ship's own usage. 

Cog H Material. The large cube of Cog H in Round 1 is largely explained by the ex- 
reme assumptions. However, this relatively large space requirement for insurance purposes 
isalso a result of the sizeable number of H items which were assigned a high military worth. 

Cog N Material. The cube of Cog N items included in each round of stocking is small. 
Except for Cog G material, Cog N is the only case where the cube of R1 is less than R2 or R*2 
(more material stocked on the basis of usage rather than insurance requirements). An obvious 


‘ason for this is that relatively few N items were assigned high military worth. 
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TABLE 1 
Simulation Results for Measuring the Severity 
of the Shipboard Storage Limitation 
(in cubic feet) 





Stocking Cognizance 


Round 





N = 
Rl 26 488 








R2 32 14 13 363 





294 83 6 465 





s 288 288 49 851 


—_———$——————— ——___—__+— —— 








T* 313 357 42 953 
Legend: 


Cog G = General stores material R2 = Second round of stocking, 
based on item usage during 
time period 1. 





























Cog H = Ship's parts 


Cog N = Electronics parts 

Cog P = Parts peculiar to sub ss Cube of sommes used during 
time period 2. 

Cog Z = Ordnance parts 

T =R1 + R2 (total cube of sim- 


Rl = First round of stocking, ulated allowance list) 


based on square root of 
population of all high- 
military-worth independ- 
ent of usage. 


T* = R1 + R*2. 


Cog P Material. The cube of Cog P material included in R1 is relatively large. This 


is explained by the fact that, relative to other cogs, more P items had the combined charac- 





teristics of high military worth, large unit cube, and large populations. The significant dif- 
ference between the cubes of R2 and R*2 (usage in two different time periods) is due not to dif- 
ferences in usage by the ship itself but to the cube of items used on account of the ship by 
shipyards for repair and alteration purposes. 

Cog Z Material. The cube of Cog Z items stocked in each round is small. This is 





explained by the low populations and low usage of Z material on the sample submarine. 
Table 1 represents the cube requirements for loading the sample ship under the ex- 
treme assumptions previously described. The actual storage capacity of the sample ship is 
780 cubic feet. Even with the extreme policies employed, there is still ample space for 
stocking the insurance level, Rl. When item usage in the first time period is added to the in- 
surance level (Rl + R2), the total cube requirement exceeds the actual space constraint by 
approximately 70 cubic feet. In the case of the second time period, the actual space con- 
straint is exceeded by approximately 170 cubic feet. It should be noted, however, that the 
usage includes shipyard repair and alteration data as well as ship's own usage. If the extreme 
assumptions for computing R1 and R2 had been modified, it is apparent that the storage ca- 


pacity of the sample ship would be sufficient to permit the stocking of both an insurance level 
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of supply and the usage of all items for almost a two year period. Statistical evidence of this 


is presented in the next section. 

While an analysis of these findings has been treated in the conclusions of this report, it is 
significant at this point to state that, in the light of these measured results, it is apparent that 
the severity of the shipboard storage limitation has been overemphasized in the past. Further 
york on the USS TIRU is expected to yield additional insights into this problem. In particular 
it is planned to obtain information relative to on-board "inventories" so that the role of the 


space constraint for the allowance list may become even more transparent. 


Evaluating the Effectiveness of Alternative Allowance List Models 

Introduction 

The previous section dealt with storage-space requirement for a shipboard stocking 
policy under extreme assumptions. The primary purpose of this first simulation was to obtain 
information on the severity of the space constraint. The second simulation, described in this 
section, was concerned with evaluating the effectiveness of alternative allowance list policies 
under less extreme assumptions. The effectiveness of a particular policy was evaluated by 
comparing the sample allowance list (based on one inter-overhaul period) with the actual usage 
which occurred in the subsequent period. Shortage counts provided a basis for evaluation. 

Allowance List Models 





Three models (each model reflecting a variation in stocking policy) and the actual al- 
lowance list for the sample ship were used in the simulation. The following general policy 
rules are applicable to each: 

(a) For each item, only the population of its high-military-worth equipment applica- 
tions was considered in the determination of the insurance level of stock (Round 1). 

(b) A high-worth item is defined as a part with one or more high-worth equipment ap- 
plications, where the part is essential to the operation of the parent equipment. An important 
qualification for each of the models considered is that parts were treated as having high worth 
ifthey met the criteria in the preceding definition, independent of whether or not shortages of : 
such parts could be compensated for by on-board manufacture, and/or jury-rigging, and/or 
cannibalization . 

(c) For each item, the ship's own usage as contrasted with usage from all sources was 
tonsidered in the stockage formulation and evaluation. 

The various models reflected the following unique policy considerations: 

Policy 1. In Round 1, high-worth items are stocked on the basis of the square root of 
the population of the item's high-worth applications. 

Policy 1A. In Round 1, a quantity of one is stocked for each of the high-worth items 
independent of the population of its high-worth equipment applications. 

Policy 2. In Round 1, Policy 2 limits the range and depth of high-worth items to that 
level of stock carried on the "actual" allowance list in use by the sample ship for the time pe- 
tied under consideration. In effect, Policy 2 duplicates the methodology inherent in the actual 


list for stocking high-worth items. In the case of low - worthitems, Policy 2 differs significantly 
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from the actual list in utilizing past usage data as the determinant of item stock and q. 
durance levels. In effect, Policy 2 employs the standard ALTP formulation (duplicating Poli. 
cies 1 and 1A) for determining the levels of low-worth items. 


Considerations and Definitions 





(a) The results reported upon for this simulation include only Cog P items (mechani 
and electrical unique submarine parts) and Cog N items (electronics parts). 

(b) Only the stable population was included in the study, i.e., items installed on the 
ship throughout the entire test period, April 1952-June 1956. 

(c) A range shortage is defined as a demand for an item which is not carried on the 
particular model or the actual allowance list being evaluated. 

(d) A depth shortage is defined as a case where the total quantity demanded for an ite 
over the inter-overhaul period exceeds the quantity stocked on the particular model or the x. 
tual allowance list being evaluated. 


Discussion of Cog-P Results 





The results of the simulation for the various models and the actual list for Cog Pare 
shown in Table 2. 


TABLE 2 
Simulation Results for Measuring the Effectiveness 
of Alternative Allowance List Policies 
(Cog P) 


| No.of | No.of | No.of No.of | Cubic feet | 
Policy | Items | Items | Range | Depth | oflItems | 

Stocked Demanded Shortages | Shortages| Stocked 
1240 248 0 | 33 
High 1A 1240 248 0 104 87 
Worth 2 547 248 95 | 39 23 
Actual 547 248 95 39 23 





] 
| 











190 


| 
| 
| 
| 
| 


Low (1,1A,or 2 281 177 60 | 24 4 
Worth Actual 827 177 57 | 39 30 


a ———— 








The data in Table 2 are described below. For purposes of clarity, each policy is ds 
cussed separately. Comparisons among the various policies are also presented. 

Policy 1. By use of Policy 1 (square root formula used to determine depth of high- 
worth items), 1240 high-worth items were stocked. During the second inter-overhaul perio 
there were demands for 248 different high-worth items. A study of the table shows that ze!" 
"range shortages" were recorded for the model. This was due to the formulation which dit 
tated the stocking of all high-worth items. In the case of depth shortages, the table shows 
that, for 33 items, the total quantities demanded during the inter-overhaul period exceeded t# 


number of units stocked by at least one unit. Since this total of 33 depth shortages is less ti# 





that re 
more § 


insura 


than th 


items | 


) was re 
» items 

worth | 
sults i 
p this of 


Fon the 


for hig 


cubic { 


with th 
items | 
worth 


levels 
pertail 
finding 
the ral 
the act 
is to p 
zero U 


zero U 


Of furt 


propor 
additio 
list. 
formu! 
(items 
Thirty 
plicie 
the qu: 
the qu: 
ple of 

10; the 
quanti 
and bo 


the AJ 


y is dis 


high- 
period: 
at zero 
th dic- 
10WSs 
>eded tt 


less the 


SIMULATIONS OF ALTERNATIVE ALLOWANCE LIST POLICIES 145 


that recorded for any of the other policies, it would appear that the square root formula is the 


more satisfactory formulation from the standpoint of providing an adequate level of stock for 


© insurance type items. 


The high-worth items stocked for Policy 1 utilized a space of 190 cubic feet, greater 


© than that of any other policy. It should be noted, however, that of the total of 1240 high-worth 
4 items stocked, 22 items accounted for 90 cubic feet of space. No usage from any data source 


) was recorded for these 22 items in either time period. It may be that the inclusion of these 


items in the simulations resulted from errors or from lack of adequate criteria in the military- 
worth questionnaires. Of real significance is the fact that use of greater space by Model 1 re- 


sults in the elimination of all high-worth range shortages. Further, as evidenced from Table 1, 


| this operationally desired result is obtained without imposing a critical storage-space problem 


' onthe ship. It is‘of some interest to note that the total space utilized by Policy 1 for Cog P 


for high-worth items (190 cubic feet) is considerably less than the total space for Cog P (274 
cubic feet) for stocking under extreme assumptions. 

The significance of the results for Policy 1 are further underscored by a comparison 
with the actual allowance list. For the actual list, out of a total of 248 different high-worth 
items demanded, 95 of these items were not stocked; thereby incurring the result of 95 high- 
worth range shortages shown in Table 2. 

In the case of low-worth items, Policies 1, 1A, and 2 are similar in establishing stock 
levels (range and depth) solely on the basis of past usage. Hence, the data for low-worth items 
pertaining to each of these policies are the same in Table 2. An important result here is the 
finding that employment of the basic ALTP formulation resulted in a two-thirds reduction in 
the range of items stocked over the actual allowance list; 827 different items were stocked by 
the actual list, and 281 items were stocked by the ALTP policies. Another way of stating this 
is to point out that two-thirds of the low-worth Cog P items included on the actual list had 
zero usage histories. Items having both of these characteristics, low-military-worth and 
zero usage histories, are automatically excluded from the load under the ALTP formulation. 
Of further interest is the result that the great reduction in the stocked range did not incur a 
proportional increase in the number of range shortages. In fact, for Cog P items, only three 
additional low-worth range shortages were recorded for the ALTP policies over the actual 
list. Additionally, despite its reduction of the numbers of low-worth items stocked, the ALTP 
formulation did better than the actual list in reducing the number of low-worth depth shortages 
\items stocked, but not in sufficient quantities for the inter-overhaul endurance period). 

Thirty nine low-worth depth shortages were registered for the actual list and 24 for the ALTP 
Dlicies. It is of some importance to note here that an analysis of depth shortages shows that 


the quantities stocked for low-worth items under the ALTP formulation more nearly satisfied 


the quantities demianded in the second time period than did the actual allowance list. An exam- 


ple of this would be a case wherein, for a single item, the ALTP policies stock a quantity of 

10; the actual list stocks a quantity of 2. The total demand in the second time period is for a 

Wantity of 12. Both the ALTP policies and the actual list fail to satisfy the total demand, 

ind both. in Table 2, would be debited with a depth shortage. However, in the example given, 


‘@ ALTP policies more nearly satisfied the total demand. 
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Noting again that low-worth items were stocked solely on the basis of past usage, the 
greater effectiveness of the ALTP policies tends to support the inclusion of historical usage 
data in the determination of shipboard stock levels. 

Policy 1A. Policy 1A is the same as Policy 1, with the exception of the treatment of 
high-worth items in Round 1; in the case of Policy 1A, a quantity of 1 of each high-worth item 
is stocked independent of the item's population. This variation affects the depth of high-wort) 
items stocked. It does not, unless storage space is a critical problem, affect the range. Th 
similarities between the two policies are evidenced in the results shown in Table 2. Both poli- 
cies (by definition) stock the same range of high-worth items; both are successful in eliminat- 
ing all high-worth range shortages. In the case of low-worth items, the results for Policies | 
and 1A (by definition of the policies) are exactly the same. 

The difference between the two policies is particularly evidenced in the increase of 
high-worth depth shortages for Policy 1A over Policy 1 (104 shortages for Policy 1A; 33 short. 


ages for Policy 1). This considerable increase in depth shortages is the direct result of stock. 


ing only 1 unit of each high-worth item for Round 1 in place of employing the square root 


Formula of Policy 1. It would appear from the above discussion that the added protection of 
the square root formula is an important consideration. 

Another factor to be considered in the evaluation of Policy 1A is that its employment 
permits a considerable reduction in the storage-space requirement for high-worth items. The 
space saving characteristic of this model, however, should be examined in the light of the sig- 
nificant increase in high-worth depth shortages. In effect, storage space is being conserved a 
the cost of increased requisitioning on the part of the ship. 

Policy 2. Policy 2 duplicates the methodology inherent in the actual allowance list for 
stocking high-worth items. For this reason, the two policies show the same results for high- 
worth items in Table 2. 

In the case of low-worth items, Policy 2 differs from the actual list in utilizing past 
usage data as the determinant of item stock and endurance levels. In this way, Policy 2, as 
shown in Table 2, has the advantage (along with Policies 1 and 1A) of greatly reducing the stock 
level of low-worth items without significantly increasing the range-shortage counts. Depth 
shortages are reduced. 

Discussion of Cog N Results 

The results of the simulation for the various models and the actual allowance list for 
Cog N are shown in Table 3. The data and chart headings presented in Table 3 have the same 
meanings as those offered in Table 2. The simulation results for Cog N very much parallel 
the findings for Cog P. For this reason, only the unique aspects of the Cog N results are in- 
cluded in the following discussion. 

Policy 1. The conclusions to be drawn from an analysis of high-worth items for Cog 
for Policy 1 are similar to those drawn for Cog P. Employment of this policy, in the case of 
both material commodities, has resulted in: (1) elimination of all high-worth range shortages: 
and (2) a significant reduction over the actual allowance list in the number of high-worth depth 


shortages recorded. The Cog N results differ from the Cog P results in certain aspects. *0 
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TABLE 3 


Simulation Results for Measuring theEffectivenes 
of Alternative Allowance List Policies 


(Cog N) 





No. of 
Items 
Stocked 


No. of 
Items 
Demanded 


No. of 
Range 
Shortages 


No. of 
Depth 
Shortages 


Cubic feet 
of Items 
Stocked 





423 


134 
134 


0 
0 


13 
11 


134 16 9 
134 16 9 


- ee | 
1, 1A,or 2 
Actual 


165 | as 41 
165 63 32 





























high-worth items, the cube of the items stocked for Policy 1 represents only a slight increase 
over the storage-space requirement for the actual list. This contrasts with the Cog P result 
where the Policy 1 cube increase over the actual list was considerable. In the same way, the 
number of different items stocked for Policy 1, Cog N, differed from the Cog P result in show 
ing only a slight increase over the actual allowance list (423 items stocked for Policy 1; 380 
items stocked for the actual list). This last result would seem to indicate that the actual al- 
lowance list for Cog N, while not as satisfactory as the Policy 1 list, is superior to the Cog 
actual list in terms of stocking an adequate range of high-worth parts. 

In the case of low-worth items, the results for Cog N are strikingly similar to those 
forCog P. Employment of the ALTP formulation, in the case of both commodities, has re- 
sulted in: (1) a great reduction in the number of low-worth items stocked; (2) achievement of 
this stocked range reduction without incurring a proportional increase in the number of range 
shortages; (3) achievement of a significant reduction in the number of depth shortages re- 
worded. For Cog N, the reduction of the range of items stocked over the actual list is even 
more marked than was the case for Cog P (a stocked range reduction of 88 percent for Cog N; 
areduction of 66 percent for Cog P). 

It should again be noted that the low-worth results for Policies 1A and 2 are the same 
as for Policy 1. 

Policy 1A. Employment of Policy 1A for Cog N shows a similar result to that found for 
Cog P; Policy 1A incurs a significant increase in high-worth depth shortages over the actual 
illowance list. This increase is due to the policy of stocking only a quantity of 1 of each high- 
vorth item independent of the item's population. The Cog N results differ from the Cog P 
"esults in one aspect, this being that employment of Policy 1A for Cog N represents only a 
slight increase over the actual list in terms of the cubic space requirement. Moreover, in 
‘trast to the Cog P results, the saving in storage space of Policy 1A over Policy 1 is not 


‘iificant. Here, the Cog N results for Policy 1A indicate a doubling in the number of high- 
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worth depth shortages over the Policy 1 list at a saving of only two cubic feet for the Policy 
1A list. 

Policy 2. Policy 2 duplicates the methodology inherent in the actual allowance list jo; 
stocking high-worth items. For this-reason, the two policies (Policy 2 and the actual list) 
show similar results for Cog N and Cog P. 


The low-worth item result for Cog N is the same as the result for Policies 1 and 1A, 


previously discussed. 


SUMMARY AND CONCLUSIONS 

This paper describes a simulation, the purpose of which was to permit an evaluation ¢j 
alternative policies for constructing Allowance Lists for naval vessels. The formulation in- 
cludes a consideration of the following factors: the time period of support, criteria for selec. 
ing the range and depth of insurance items, and the shipboard storage limitations. It requires 
information concerning actual usage rates, population of parts and components, unit cube of 
items, and item military worth. 

The simulations were primarily devoted to testing the effectiveness of various Allovw- 
ance List policies. A second purpose was to permit an evaluation of the severity of the ship- 
board space constraint. For these tests a fleet type submarine was selected as the sample 
ship. Thus the sample consisted of one submarine, including its entire population of installed 
parts. The observations included data pertaining to several years. 

The stocking of the vessel was simulated for some future period by using various stock 
ing policies and utilizing historical data. For the "past" as well as "future" periods the actu 
usage data were employed. In no case was hypothetical data introduced. The effectiveness oj 
a particular policy was evaluated by comparing the sample Allowance List with the actual 
usage which occurred in the subsequent period. Also the actual Allowance List was evaluated 
in the same manner, thus providing a basis for comparing current Allowance List methodolog 
with the proposed formulations. 

One significant result of the simulation is the findings that even under extreme as- 
sumptions and conditions (i.e., a submarine is considered to be the most limited vessel as {a 
as space is concerned) the storage capacity of the vessel is sufficient to permit the stocking! 
both an insurance level of supply and the usage of all items for approximately a two year peti- 
od. This has far-reaching implications, not only for the Allowance List problem but for the 
distribution of stocks throughout the entire supply system. For example, decreased reliance 
on tenders as supply sources for technical spares, if this is considered operationally desira- 
ble or necessary, appears to be a distinct possibility. A second result with at least as much 
significance is that, given information concerning the military worth of items and knowledge # 
historical usage rates, the employment of relatively simple rules, without violation of stron 
empirical evidences, can result in significant improvements over existing procedures. The 
conclusion can be drawn that the use of the proposed formulation would yield the following: 

1. Feasible endurance loading of technical spares. 


2. Minimum high military-worth range shortages. 
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3. Reduction of depth shortages for all items. 


4. Effective purging from Allowance Lists of items having both low military worth and 
zero movement. 


. Capability for tailoring Allowance Lists to meet specific operational objectives. 
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AN APPROXIMATING ALGORITHM FOR 
AN OPTIMUM AIM-POINTS PROBLEM *!# 


Sidney I. Firstman 


The RAND Corporation 





This paper describes the development and employment of an algorithm 
that obtains approximate solutions in integers to the problem of assign- 
ing weapons to aim points within a target complex s0 as to minimize 
the expected target value remaining after the attack. The target com- 
plex contains two or more independent targets located such that (a) a 
nuclear weapon aimed at one target has a nonzero probability of also 
destroying another target in the complex, (b) a nuclear weapon directed 
between two or more targets has a nonzero probability of destroying 
more than one of the targets, or (c) both conditions exist. Also dis- 
cussed is the extension of the basic technique to the problem of finding 
the marginal return per weapon allocated. Then, with a dynamic- 
programming formulation, a method of solving the larger problem of 
optimum allocation of a stockpile of weapons over a set of target com- 
plexes is demonstrated. This broader allocation uses the results of the 
| algorithm. The algorithm and several useful subroutines have been 
| programmed for the IBM-704 computer. 








INTRODUCTION 


Often in problems of targeting or site location, one finds that a target (or portion of a 
larger target that can be considered as a separate target) is so located that, because of its 
hardness and the attacking missile(s) yield and inaccuracy, a (nuclear) weapon aimed at a nearby 
larget has a nonzero probability of damaging or destroying the former target. Or sometimes if 
amissile were to be aimed between two or more targets it would have nonzero probabilities of 
destroying more than one of the targets. In cases such as these, the greatest return in target 
value destroyed for the weapons allocated can in general be realized by not aiming the missiles 
directly at the targets but, instead, aiming them at some point between the several targets. 

In such cases we want to know how best to attack the target complex. That is, if the 
offense has a given number of weapons to direct against a target complex which is composed of 
several or many quasi-separate targets, where should each weapon be aimed so that the re- 
sultant expected damage is maximized? Weapons can be aimed directly at targets or at some 


chosen point in the space between targets. In making these assignments of weapons to aim 
—_— 
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points, one may want to consider the estimated missile reliability and any expected enemy 
missile defense while also considering the missile inaccuracy and lethal radius for each target, 
In Figure 1, for example, one may be concerned with attacking a complex of surface-to-air 
missile (SAM) sites where each site operates independently and has a particular estimated kil] 
potential. The object of this attack could be to minimize the aggregated kill potential remaining 


after the attack so as to aid manned bombers to penetrate in a follow-up mission. 
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Figure 1 - Complex of SAM sites (each site is point target) 


In other target applications, one may be concerned with attacking a city (Figure 2) with 
weapons that cannot cover the entire city with the required levels of overpressure for either 
damage or destruction. Certain sections of the city have specific value (or relative value) as 
targets, and the intent of the attack could be to minimize the expected target value remaining 
after the attack. In Figure 2 each section of interest is approximated by a corresponding point 
target. The harbor has been split into two half harbors, each one-half the total harbor target 
value. 

Alternatively, if one is planning a complex of sites, each of which operates independent}, 
he could be concerned with estimating the vulnerability of the complex to an enemy attack that 
planned to minimize the effectiveness of the complex. For these applications, the problem of 
minimizing the target value remaining after an attack is the complementary problem of maxi- 
mizing the expected target value destroyed. The same assignment of weapons to aim points 


will satisfy both criteria of mission success. 
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Figure 2 - City target (point target approximation) 


At present, however, there is no method for finding an exact solution to the assignment 
problem posed above other than an exhaustive search over all possible combinations of assign- 
ments. Following a precise statement of the problem and a discussion of a potentially useful 
method of solution, an algorithm will be described which will yield approximate solutions in 


integers to this problem. The algorithm has been programmed for the IBM-704 computer. 


PROBLEM STATEMENT 

The problem statement and approximating algorithm will be presented with the city 
target complex of Figure 2 as an example. Figure 3 shows the city target complex superim- 
posed on an arbitrary, rectangular, coordinate grid. Each target is characterized by its rela- 
tive value and its hardness, measured in psi of overpressure required for its destruction. If 
we allow weapons to be aimed only at the targets or intersections of the grid (which can be as 
coarse or fine as warranted for the particular application) and if we label each usable! aim 


pointas j= 1, 2, . .. , 71, then the problem of aiming is to assign weapons to the aim points 


ilneitanintencinnininene 


For this example it is assumed that the missile impact distribution is circular-normal. If this 
assumption is made then because of the nature of the blast destruction phenomenon the only 
aim points that will prove to be profitable for employment are those whichare contained in the 
convex set formed by joining the extreme targets in the complex. This limitation on permis- 
Sible aim points does not hold, in general, for an arbitrary impact distribution. 
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Figure 3 - City target on grid 


so as to minimize the expected combined target value remaining after the attack. Assuming 
that the weapons are delivered independently according to some given impact distribution and 


that no information of results is obtained between shots, then the function to be minimized is: 


6 71 
P(m) = Div, TT ay 


iz] 


ai probability that the :* target survives a weapon aimed at the ;* aim point, 
x, number of weapons aimed at the ;* aim point, 


and subject to the constraints 


is 9 ee. 


If one wants to account for estimates of weapon reliability and enemy defense potential, 
say against ICBM weapons, then a can be defined as 


PT oP ij 
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where 
Pij = probability that the ” target is destroyed (or damaged) by a weapon delivered 
, .th 
against the j aim point, 


r, = estimate of weapon reliability (the probability of successful delivery to the 


1 
target area), 


r,= estimate of defense effectiveness (the probability of successful penetration to 


: target through a defense system). 

By taking the logarithm of the TT portion of the objective function (as done by Dantzig 
in a note to Ref.[1])* the problem can be formulated in a familiar programming format. Step- 
by-step, for a general target complex of n targets and s aim points, this formulation is ob- 


tained as follows. For P(m) defined as above and 


s 
=- 1 
y pm x Ina, 
j=l 


the objective function P(m) becomes 


P(m) = z. vie . 
i=l 


and by letting 1n a - Ci the problem becomes that of minimizing 


“=F =F 
P(m) = v,e * + vee ae 


subject to the linear relationships 


In this form, solutions to problems can be obtained by using a modified linear- 


programming technique. The resultant assignment of missiles to aim points will not, however, 


ee 
In Ref. [1] A. S. Manne considered the problem of assigning guns to targets, where a gun 
aimed at one target could not damage any other target. 





156 S. I FIRSTMAN 


be in integer form; and as specific target assignments are necessary operationally, there is no 
physical meaning to a solution that specifies the assignment of, say, 0.2 missiles to aim point 
13 and 0.4 missiles to aim point 23, etc. Assignment information would be lost in the rounding 
process for such small numbers. (Information contained in the solution of the problem is valy. 
able, however, in that the minimum P(m) of integer problems will be bounded by the P(m) of 
the continuous linear-programming problems. ) 


The problem of obtaining integer solutions is further complicated by the fact that each 


of the x; must be integers and, as can be seen, each of the yi are, in general, nonintegers. 


Because of this mixture of integers and nonintegers in the linear relationships and also because 
of the nonlinear objective function, present techniques for obtaining integer solutions to linear- 
programming problems [2] cannot be employed. Hopefully, as a result of the present efforts 
being directed towards extending the capabilities of mathematical programming (linear and 
otherwise), a technique will be developed whereby exact integer solutions can be obtained for 
this assignment problem. 

Until such time, however, a technique is needed to obtain at least approximate solutions 
by the use of integer assignments, and this algorithm was developed for this interim purpose. 
It is not elegant, and it employs only elementary numerical calculations. It was developed 
simply because an integer solution was needed for the aiming problem described, and an ap- 
proximate solution was felt to be allowable, especially when considered in the context of the 
uncertainty which often surrounds the primary elements of the problem (e.g., exact locations 
of targets and weapon (circular error probable)(CEP)). 

The algorithm will be described by use of the city target complex of Figures 2 and 3 as 
an example. A precise statement of the algorithm can be found following the example, anda 


complete description of the algorithm, its development, and employment can be found in Ref. 


[3]. 


SOLUTION BY ALGORITHM 

We shall examine the case where we want to attack the city-target complex with six 
missiles of 1/2-megaton (MT) yield which are delivered according toa circular-normal distribution 
witha1l-1/2nmiCEP. The lethal radii (assuming point targets and a dichotomy of lethality) for 
this yield are as shown in Figure 3 for each of the targets. As can be seen, several of the 
lethal radii overlap, so that a missile that is detonated within large areas will destroy two, 
and in some places three, of the targets. 

Before making the first step in the operation of the algorithm, it is necessary to com- 
pute all the applicable survival probabilities. 3 Fora reliability and penetration probability 
factor of one, these survival probabilities are as shown in Table 1. The numbers in paren- 


theses are the probabilities of target survival if a weapon is aimed at the aim point indicated 
as a subscript. 


The machine program, which will be discussed in a subsequent section, contains a subroutine 
for computing the set of ajj's when a circular-normal impact distribution is used. 





itine 


ALGORITHM FOR OPTIMUM AIM-POINTING PROBLEM 


TABLE 1 
Survival Probabilities 
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1 2 3 ot 5 6 
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The first step in the operation of the algorithm (according to paragraph five of the 
algorithm) is to obtain a starting set of aim points; these will comprise the initial aim-point 
vector, Jy where an aim-point vector is defined, simply, as that subset of aim points that is 
being considered for assignment at any time. If weapons are assigned to aim points jy 


ly» Bg is i (where duplication is allowed), then it will be useful to speak of the vector of 
aim points: 


J= Gy» jg» * © a 


The initial aim-point vector is found by seeking that aim point j which yields the minimum a 


J 
for each target i. These aim points will, in general, be the aim points of the targets them- 


selves. For this example, we shall choose the aim points of the first row in Table 1. This 
gives 
Jy = (28, 11, 66, 34, 1, 67). 
These aim points give a starting objective function value of 
r = 4(0. 787)(0.949)(0.975) . . . + 3(0.878)(0.591)(0. 959) 


. +... + 1(0.949)(0.940)(0.998).. . 
= 6.61 
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This starting objective function has, for as many targets as there are weapons to be assigned, 
the smallest of all possible products att and each is multiplied by other terms which are 
each less than unity. Subsequent steps of the algorithm are a procedure for decreasing the 


value of the objective function by making a sequence of single item changes in the aim-point 
vector. 


We want to use a search pattern that will cause the fastest decrease in the objective 


function. To do this we observe that, while aiming at each target will give the minimum as. 


for that target, we have also fixed m-1lother aij terms. That is, by choosing aim point 11 for 


target 2, we get ao WwW which is the smallest of all Aoi but we also have a WwW ag weet 


as terms in the objective function. These aim points, in combination and weighted by the 
target values, may not necessarily be a good set of “> (For this problem, ag 4 anda 
b] 


are the largest of all possible a4; and a6;°) 
We therefore need a compromise set of aim points, as it were, which, when multiplied 


6, 11 


together with each of the target values, and then summed, will cause the objective function to 


decrease. That is, we want to search for that as. associated with each target, which, when 





brought into the objective function in combination with the other a,;'8, which are then fixed, 
will minimize the objective function. 

The algorithm is designed to conduct an efficient, directed search for the optimum set 
of aim points. The process can be seen in Table 2, which is a copy of the printout of the first 
40 steps of the computational routine. The oth step is the one where we chose the starting aim- 
point vector. For step one and all subsequent steps we chose an aim point, called iy according 


to the following general rule (which is paragraph seven in the algorithm): for each testing 
+. 


39 


sequence, the aim points will be used as j sequentially, starting with the j of minimum a4; 


then that of minimum Aoi - » « , and moving through the entire matrix, row by row. Aj 
which has been previously used in the testing sequence will be skipped in this process. 

In this case we chose aim point 28 and will proceed to test it (according to paragraph 
eight of the algorithm) against each aim point in the vector in steps 1 through 6. The aim 
point we are testing j against is noted as i and the test consists merely of replacing j by j in 
the aim-point vector, computing P, which contains the ai; instead of the ais terms, and com- 


paring P with the running Toen? If P<P sy then j replaces j ir the vector and P becomes the 
new Tonie? 

In step 4 (according to paragraph ten in the algorithm), aim point 28 replaces aim 
point 34 in the vector, in step 5 it replaces aim point 1, and in step 6 it replaces 67. The 
algorithm then instructs a re-examination of aim point 28, and in step 9 aim point 28 replaces 
aim point 11. Meanwhile, the value of the objective function wa has decreased from 6.61 to 
5.65. 

After the single-step testing of aim point 28 is completed, the algorithm instructs the 
choice of a new i}, and the process continues. The aim points that we search over first are 
those which are closest to each target. (Steps 25 to 30 are concerned with testing aim point 


66, etc.) These aim points, as we move farther from each target, will have the desired 





ALGORITHM FOR OPTIMUM AIM-POINTING PROBLEM 


TABLE 2 
Computing Routine 





Aim Point Vector 





66 11 34 
66 11 34 
66 11 34 
66 11 34 
66 11 28 
66 11 28 
66 11 28 
66 11 28 
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properties of retaining small values of a for the target being moved away from, while pro- 
gressively decreasing in value of as. for other targets. The distance moved away from each 


target is reflected in P(m), weighted by the value of each target. 


For each step of the search, we change one aim point at a time and observe the effect 


on P(m). If P(m) decreases, we keep the new aim point in favor of the old. In this manner, 


the aim-point vector is changed in discrete singular steps when a change will cause a decrease 
in the value of P(m). Because we want to force our search to be centered about the targets 
moving progressively from the targets to the center, the algorithm calls for the search to 
return to the aim points of the targets themselves each time a change is made in the aim-point 
vector. We know that the search is complete when a cycle of tests proceeds through all the 
aim points without making a change in the vector (paragraph eleven of the algorithm). 


For the sake of interest, the final aim-point vector is: 
J = (20, 25, 29, 29, 29, 58), 


which gives a value of P(m) = 5.49. (The computing time per program step on the IBM-704 is 
given by 


n (0.240 + 0.420 m) + 0.840 milliseconds/step 


when no change in aim-point vector is made. This solution required 2592 steps, which in turn 
required approximately 45 seconds of machine time.) 

Each step in the algorithm is designed to cause a decrease in the value of P(m). But 
these steps look at changing only one term in the aim-point vector at a time, and the process 
is ended in an arbitrary manner. An extension of the method would be to examine all pairs of 
aim points, then all triplets, etc. In order to find the true minimum value of P(m), we would 
need to change all m terms simultaneously and look for the optimum combination. For large 
problems this exhaustive search is not feasible, and, in fact, examining doublets, triplets, 
etc., is also excessively time consuming. Therefore, the final set of aim points is a com- 
promise set, as it were, and may not be optimum. It can be seen, however, that the final set 
of aim points represents a usable solution to this problem, since the target damage is greater 
than that obtainable by either intuition or rule-of-thumb assignments. 

Figure 4 also shows the minimum value of P(m) that would be obtained if fractional 
assignments were physically possible. This value was obtained by using a linear-programming 
routine and the formulation presented previously. For this problem the answers are almost 
identical. Usually a true integer solution would lie between these two solutions. In general, 
because of the bounds on the set of permissible solutions that are imposed by integer con- 
straints, the integer solution will yield a larger P(m) than the noninteger solution| 4]. 

For this case, the noninteger assignments are: 

Xoe = 0.75, 
Xog = 3.74, 
xX 3 = 0.58, 


5 


Xoo = 0.93, 


which give a P(m) = 5.48. 
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With a rounded solution, the assignments are: 1 
= | —- Lyotat TARGET VALUE=I5 
Xor =1, BPs sere i aad, 


Xoq = 4: 


Xoo = I, 


and P(m) = 5.57. 


P . ° 4 a 
interesting, however, to obtain non- wee eete 
- ony pe oli : NONINTEGER RESULT - +--- ¢ 


integer solutions to some problems, just to see what is 








being lost by the combination of: (a) integer constraints 


: 
5 

and (b) what may be a bad approximate solution found by ¢ ‘ 
0 





5 10 
CHANGE NUMBER 


this algorithm. 


Statement of Algorithm Figure 4 - Value of objective 
function 
1. Rank targets according to value vi » and label 
such that 
12 %92%3° °° 2°, 


2. Use the subroutine or hand method to compute the set of a,.'s 


Vv 


3. For each target, rank the a5 according to 


Qa, Sa, Sa, «++ SO, - 

Nir Yio is Nis 
(Note: The notation j. ik (k =1, 2, . .. , s) denotes that j which gives the yh smallest a for 
the i = target. It will be used in this section only when needed for the sake of clarity.) 


4. Form the s-by-n matrix of a, 5 for each target with the *,* ranked as in paragraph 
three. 











a. 7 ae - 
liis 2i95 “ns 





(Note: For hand computations it will often prove convenient to form a table of the ji 8 from 
the preceding table and to eliminate from the table any j which appears in a preceding row, or 
ina column within the same row.) 


5. Form the initial aim-point vector Jo = (i> jg1> es 
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a. If n2m, choose the first m j's, iv joy? -eedap such that 


Jy = Gyy doy + + + dina) 
b. If n<m, choose all the i,1'8 and repeat the first jit s(i.e., jip joy?) until have p 


terms in the aim-point vector. Then m-n terms will be repeated such that 


Jo = Guy joys + + + diya? Jaye Jaa + + + iqm-np1?> 
(Note: The logic of this method can be shown by expanding the objective function 
x. 
= J 
P(m) a: v; 1] @) 
i j 
*j 
11 
v.08... } a.. ) 
aaa Noy 


vo(a 


4 
ee, 
JQ1 


7h11 
x, 

-+v (a 11 : i 
n yy "21 31 
Choosing the j of minimum a for each target gives a starting objective function which has, 
for as many targets as there are weapons, the smallest of all possible terms vi a. multiplied 
by other terms which are each less than unity. Subsequent steps in the algorithm will be con- 
cerned with changing the vector, one term at a time, so as to continuously decrease P.) 

6. Form the initial objective function v. by employing the a's associated with each j 
of the vector. 

7. To improve the aim-point vector, pick an aim point, called 4 according to the fol- 
lowing general rule. For each testing sequence, the aim points will be used asj sequentially, 


starting with the j of aij and moving through the entire matrix, row by row. Aj which has 
11 
been previously used in the testing sequence will be skipped in this process. 


(Note: Each column contains s terms obtained by listing ~ as. for each of the s aim points. 


As there are only s unique aim points, the search for the ; 's . be over only these s points; 


duplications of use should be passed over.) 

8. Test j against each j, “yg > in the veuter, in turn, to determine whether the 
vector formed by replacing j with will yield . P aa . 

9. If there is no P 4 - (or, in general P <p _ where Pw denotes the P(m) obtained 
by use of the aim points of the then-present vector) then choose another j according to para- 
graph seven and repeat testing process by using each j sequentially. 

(Note: The initial aim-point vector Jy = Gi joy? . « - ) can be thought of as a vector defined 
in aim-point space. The testing process of this algorithm is analogous to searching the space 
about the vector, one dimension at a time, to determine whether a change in the vector will 


improve the objective function. Intuition tells us that aim points near targets should be 
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preferred to aim points far removed from any one target of the set. This has been found to be 
true for problems where the CEP is of the same order of magnitude as the lethal radii. There- 
fore, this test procedure tests aim points in a sequence which moves from target to target and 
for each target moves from points close to the target to points farther removed. ) 

10. If for some step in this testing process a P < F ates exists, then immediately replace 


If the particular j is repeated in the existing vector, 


o * 
that j by j, and P becomes the new P 


do not immediately replace it cinssiideiianas with j but, instead, continue testing each i in turn, 
against : Then use that same j and retest each j in the vector. (This has been same! to be a 
useful technique for finding combinations that use the same j more than one time.) If j does 
not replace any other i's, a new testing sequence will now start. Return to paragraph seven 


and start testing each j, beginning with the j of a » against the new vector. 


1j 
(Note: This recycling insures that the testing siuiae moves in the manner described in the 
note to paragraph nine. ) 

11. Testing is continued according to paragraph nine and ten until each possible j has 
been used as i. without a change in the aim-point vector. That vector is the final set of aim 


points and Panes formed by using the j's of that vector is the final value of P(m). 


Perturbation Technique 

This testing process does not search over all possible combinations of aim points. 
Therefore, the final vector may not be the optimum, and the final P(m) may represent only an 
approximation to a local minimum. It is possible that the path of aim points chosen in the 
process may have necessarily excluded some other sets of aim points which would improve 
the situation. For example, the final vector may be J = (2, 6, 6, 18, 35), and it is better than 
any other vector considered in the search. But the search path from the initial vector may 
have necessarily excluded the consideration of some single combination of one or more aim 
points, say the use of 12 and 19, which was better than the combination being tested. And it 
may turn out that only J = (2, 12, 19, 19, 35) will yield a P(m) smaller than the one obtained. 
To reduce this possibility (i.e., to increase the chance of finding the optimum combination), a 
perturbation technique can be employed. This perturbation should allow the search to move 
through paths not followed in the original search. Combinations not previously tested would 
be examined, and the chance of finding a better set of j's, if one exists, would be increased. 
The extent to which one wishes to reduce the possibility of a nonoptimum final vector will determine 
the degree of perturbation employed. If desired, several perturbations could be employed. 
Certainly, the use of a perturbation is an optional procedure and it is included in the machine 
program as such.’ 


In experience with the algorithm to date, roughly 40 problems have been run, and the 
perturbation has returned to the original answer in all but one case. 





164 S. I. FIRSTMAN 


Statement of Perturbation Technique 

1. Choose at random 1, 2, 3, . . . of the aim points in the aim-point vector and 
discard them. 

2. At random select 1, 2, 3, . . . other aim points to take the places of the discarded 
aim points. 

3. Repeat paragraphs seven, eight, nine, ten, and eleven of the algorithm. 

4. If the final vector of the perturbation is identical to that found by the basic 
algorithm, stop the process. 

5. If the final vector is better (or worse) than that found by the basic algorithm, one 
may wish to repeat the perturbation process. 


EXTENSIONS OF METHOD 
Marginal Return 

The algorithm was developed to solve the particular problem of assigning weapons 
over a target complex in an effective manner. One logical extension of the method results 
when one asks: ‘What would be the marginal return if an additional weapon were to be allocated 
to the target complex?" By use of the algorithm one could readily solve for P(m + 1) and con- 
pare P(m + 1) - P(m) to the cost of the additional missile or to whatever alternative payoff 
could be obtained from the use of the missile. 

It would be convenient in cases of this nature if one did not need to start without 
previous knowledge when using the algorithm to find P(m + 1) and the associated set of aim 
points, i.e., start from the step in the algorithm where the initial aim-point vector is chosen 
according to minimum ai for the target of maximum Vie Fortunately, in many instances (but, 
unfortunately, not always) some of the aim points that comprise the final set of aim points for 
P(m) will also be members of the final set for P(m + 1). In other cases, aim points near 
those of P(m) will be used for P(m + 1). Effective use can be made of these observations, if, 
when starting the computations for m + 1 weapons, one formed the initial aim-point vector 
(paragraph five of the algorithm) with the final vector for m weapons plus one chosen in the 
manner prescribed in the algorithm. . The search will then examine aim points which lie 
about the final vector for P(m). 


Stockpile Allocation 


Repetitive use of this technique will yield.P(m) for the * city, as a function of my the 
number of weapons allocated to the "a city. This will be a discrete function P, (m,) and will 


have associated with it a final set of aim points. Knowledge of this function for each target 


complex of interest can be useful in numerous contexts. One of these contexts is to determine 


the optimal (with respect to the functions P, (m,)) allocation of a stockpile of M weapons over 


a set of T target complexes. 


The machine program, which will be discussed in a subsequent section, contains an optional 
provision for using the final aim-point vector of P(m) when computing P(m + 1). 
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To perform this larger allocation, we define a new set of functions: 


Ry (m,) = V, - P,(m,), 


or the aggregated value of the > target complex. 


The R, (m,) are seen to be monotomically increasing functions, defined in the region 
oe 
0< R, (m,) < Vv. 
The problem of optimum stockpile allocation can now be expressed as: to assign total 
stockpile of M weapons to the T target complexes so as to maximize 


3 


Q,(M) = 2) R,(m,), 


t=1 


subject to the general constraints 


Tr 
Em, =, 
t=1 


the total number of available weapons in the stockpile, and 


0 na m, <S M, 
for all t. 

Other constraints also could be imposed, such as a hypothetical strategic requirement 
that m, >2 for some or allt. Then the assignment problem would begin after the constrained 
assignments had been made. 

With or without additional constraints, the method of dynamic programming [ 5] can be 
used to obtain exact solutions to the larger allocation problem, given the functions P, (m,) 
which are obtained from the algorithm of this paper. 

Using the method and notation of dynamic programming, we consider first an allocation 
to target complex number 1. 


For T = 1, if M weapons are to be allocated, we obtain simply 
Q, (M) = R, (M). 
= 2, that is, if we want to allocate optimally over two target complexes, 


Max [R,(m,) + Q(M - m,)]. 
OSmy<M ua 2 
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This leads to the desired recursive function: 


Q,.(M) = * ag? oe ae + Qr-1 (M - m,)], 
Bie, ges 
where, for each quantity of weapons to be allocated, it is seen that the assignment of weapons 
to target complexes is made over a combination of the @ target complex and an optimal collec. 
tion of assignments for the preceding t-1 targets. Notice that Qp_,™ - m,) is always an optimum 
value, based on an optimum assignment over the preceding T-1 targets. 
The reader who is unfamiliar with the notions and methods of dynamic programming is 

referred to Ref. 6 , which contains a complete discussion of the dynamic-programming comp- 
tations and results for a similar assignment problem, and to Ref. 3, where a hypothetical 


example of this particular application is demonstrated. 


Computing Program 

The algorithm can be applied to small problems (say four targets, five weapons, and 
forty aim points) by the use of hand computations which require only a desk calculator. For 
larger problems a digital computer is needed. For this reason the algorithm has been pro- 
grammed® for the IBM-704 computer, and program decks can be obtained from The RAND 
Corporation. The program is designed to be used on the minimum-storage (8000-word) 
IBM-704, uses a three-decimal-place accurate objective function, and is capable of handling 
problems of 1 to 20 targets, 1 to 20 weapons, and 1 to 250 aim points. To use the program, 
one need merely supply the coordinates (in latitude-longitude or x-y) of the targets and usable 
aim points, the target values, and the survival probabilities of each target-aim point combina- 
tion. As noted previously, to further lessen the manual effort, the program also has a sub- 
routine for computing the necessary survival probabilities when a circular-normal distribution 


is assumed for the weapon delivery-dispersion pattern. 
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—— 
A new "pivotal" technique for systematizing the Dantzig method is ex- 
plained. The technique has been found useful in simplifying coding and 
in reducing iteration time on a digital computer. The first use of the 
technique was ina novel program aimed at problems for which the num- 
ber of destinations is many times greater than the number of sources. 
The nature ofthe program is explained, and performance data are given 
for a number of computations. 











INTRODUCTION 

In planning a general code for solving the Hitchcock transportation problem on a digital 
computer with magnetic tape as auxiliary storage, our objectives were to improve over earlier 
codes on several counts. The first goal was to develop a more efficient technique for the 
internal processing involved in an iteration. The second goal was to seek a better balance 
between internal-processing time and tape-searching time than was achieved in prior codes, 
and this despite any progress towards the first goal. The third objective was to free one 
dimension of the problem from dependence on the size of internal memory, thus permitting 
longer problems than would otherwise be practical. 

Analysis disclosed two systems ideas that contributed jointly to these goals. Both have 
special relevance to the Dantzig method of solution. The concept of "pivot, '' which facilitates 
the process of stepping from one solution to another, is the principal topic of this paper. The 
pivotal approach requires fewer steps to code than any technique we have seen. The second 
idea, that of defining a "nucleus" problem, opens the way to effective computation of a class 
of very large problems in which the number of destinations is many times greater than the 
number of sources. These two ideas characterize the Univac code resulting from the project. 


Performance data are given for a number of computations with the code. 


The Hitchcock Transportation Problem 


Consider one commodity in one time period. The commodity is available in given 


quantities a at m origins and required in given quantities b, at n destinations. The total amount 


available equals the total amount required. The unit cost of routing the commodity from origin i 


‘Manuscript received April 1, 1959. 
The authors were assisted in coding by Robert Ambler and Marie Wiseman. 
‘Now with IBM Corporation, 
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to destination j is denoted by ci The problem is to determine the number of units x to be 


routed from each origin to each destination to minimize total cost Z. Mathematically: minini, 


(1) Z=Ec,x,,, 
i,j ti 
subject to . 


(2) 


(3) Za. = Eb. ; 

i a 
where i= 1, 2, tc« 5 Meh B coe sy BD 
There is no loss of generality in assuming that m <n, as interchanges of i with j and a withb 
do not change the form of (1), (2), or (3). It is convenient to speak of an m-n problem as 
having m rows andn columns. Row i embraces the n routes associated with the o origin. 
Column j contains the m routes associated with the ;* destination. Denote by (i, j) the route 


intersected by row i and column j. 


THE SPECIALIZED SIMPLEX METHOD 
This paper starts from the specialized simplex method due to Dantzig [ 1]. To this 


method, a set of x's satisfying (2) and (3) is a feasible solution. If the set also minimizes (I), 





it is an optimum feasible solution. Mathematically, the x's are regarded as coefficients of 


vectors in a space of dimension m+n-1. The number m n-1 is central to the method, and a fea- 


sible solution of m+n-1 routes is called a basic feasible solution, or simple BFS, provided that i 


basic satisfies the mathematical condition of “linear independence.” A theorem fundamental tot 


method asserts the existence of a BFS whichminimizes (1). A graphic test for linear independent 


is exhibited in Construction 1 below. 
The specialized simplex method requires us and v. such that 


(4) u, + i ~e,°6 


for each BFS route. There are m values of u, there are n values of v, and there are n+ m-l 
costs to enter (4). To balance unknowns and equations, one unknown is assigned an arbitrary 
value. Now, the method says, let 


(5) u.+v.-c,,=4d,, 
A J 1) 1j 


be formed for all (i, j). From (4) it is seen that q is zero for BFS routes. If (5) is zero or 


negative for all routes, an optimum obtains. If (5) is positive for some route, say (p,q), a 
saving of qin will accrue to each unit shipped over (p,q). Thus a total saving 


6 Az=d 
(6) 2 = Ooq*pa 


can be achieved by adjusting the BFS to include route (p,q); to maximize savings, the route 
coefficient Xoq is made as large as possible. In determining x_, existing BFS coefficients at 
increased, decreased, or unchanged—as required by Eq. (2)—such that one coefficient, say 


X ng? takes on value zero. Dimensions are preserved by deleting route (r,s) from the BFS. 
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one complication must be faced. If more than one coefficient takes on value zero, which of the 
corresponding routes is to be deleted? 

The answer to the question can be approached in this way. If one or more of the coeffi- 
cients in a BFS take on value zero, the BFS is said to be degenerate. Degeneracy is not a 
computational problem in itself, but in equation (6) it admits the possibility that Xpq is zero, 


and if oq is zero, the "saving" is zero. This suggests the possibility of cycling, i.e., of a 


computational loop that returns to initial conditions after a series of zero savings. The first 
published solution to the problem, given in Ref.[1], suggests an "epsilon-perturbation" tech- 
nique to make degeneracy impossible. Cycling is of course precluded, but at a significant 

cost in extra processing. 

In an addition to the Dantzig method, Charnes and Cooper [2] offered a rule that bars 
cycling without defining degeneracy. Their rule is, as we interpret it: Row and column indices 
are established and remain unchanged during computation. When ties are encountered in 
candidates to leave the BFS, select routes with the lowest row number; if more than one route 
qualifies, select the one with the lowest column number. Although we will subsequently point 
out that this rule is stronger than necessary, as it stands it is very attractive from the process- 
ing viewpoint. 

It is not easy to find a case of cycling. To settle a suspicion that cycling might not even 
exist for the transportation problem, Gassner [3] recently exhibited a case of cycling ina 
44 problem. Equation (5) was positive at each change of BFS, of course. 

The processing involved in choosing a candidate route and adjusting the BFS, often 
termed an "iteration, "' will here be called an improvement. Although an improvement is never 
udertaken unless (5) is positive, the above discussion has shown that (6) can still be zero, and 
an improvement can yield a zero saving. In the definition of "improvement, " let us assume that 
processing follows some rule which prevents cycling. With this in mind, it can be stated that 
aimprovement of zero saving is not in vain, as the composition of the BFS and the solutions 
to Eq. (4) have changed; the computational process has, as usual, moved the system nearer 
{oan optimum solution. 

Because the number of possible BFS's is finite, a finite number of improvements must 
yield an optimum BFS. An improvement is possible at any route (i, j) for which Eq. (5) is 
found to be positive. In scanning the cost matrix, Eq. (5) will typically be positive for a number 
ofroutes, and the possibility of selective improvements therefore exists. On a 30-260 problem, 
Dennis [4] has compared three rules as follows: In systematically scanning the cost matrix for 
instances of positive dij» make an improvement (a) for each instance encountered, (b) for the 
largest instance in each row, or (c) for the largest instance in the entire problem. Other 
sectors of the problem may be chosen. Reported below are several computations in which the 
tule was essentially to make an improvement for the largest instance in each column. Subject 
‘0a given set of computer features and parameters, the basic problem is one of balancing 
scanning time versus other processing time. So long as one can be reduced without a com- 


pensating increase in the other, new rules are of interest. 
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To summarize the specialized simplex method, it is convenient to use the following 
notation: 


Abbrev. Description Element Dimension 
Cc matrix Cj m-n 
vector 
vector 


vector 


vector : n 


x vector Xij of BFS m+n-1 


Regardless of the detailed procedures used, the method implies steps of the following 


Generate an initial X; form U and V. 

Scan all or part of C as in (5); choose route with maximum d.. 

If dis positive, continue. Otherwise go to step 6. 

Adjust X to include new route. 

Recompute or adjust U and V. 

If all of C has been scanned without improvements, end computation; 
otherwise return to step 2. 

In expository articles, for example Henderson and Schlaifer [5], the procedures 
advanced for steps 4 and 5 require repeated scanning of the X vector and associated informa- 
tion. Isolate the components of X to be changed, they say, by iteratively scratching the compo- 
nents not to be changed. Then, after X is adjusted, recompute U and V by successive scans of 
X and associated cost information. 

There are three points to make about these "scratching" sweeps over X to isolate the 
components that need to be changed. First, from the systems standpoint, the intuitive goal 
is to try to do the job in one sweep. Second, as will be shown later, in the course of any given 
improvement, an m-n problem contains at least (n - m) components of X that cannot possibly 
change; it is wasted effort to scan these. Third, of the components open to change, a good 
proportion are usually excluded by chance. To put the whole problem another way, a desirable 
procedure will jump from one component to another in X, covering only those that need to be 
changed. 

The main purpose of this paper is to explain the essentials of such a procedure and to 
show how these essentials can be used to systematize steps 4 and 5 in their entirety. Our 


purpose will be served by introducing a set of graphical constructions on "squares" and "circles 


TRANSFORMATIONS ON ROW AND COLUMN PIVOTS 
This section contains a series of constructions which together could be said to form 
operational definitions of 'pivot'' and "nucleus." In obvious correspondence to the transportatio 


problem, we postulate a rectangle of m rows and n columns where i and j are row and colum 
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indices (Figure 1). The term "basis" is used to denote a set of m+n-1 row and column inter- 


sections, and corresponds to the (i, }) information ina BFS. See Figure la. 
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Figure 1 - Circle-square operations 

4 Route chosen to become a pivot 

® Column pivot to be removed 

© A pivot changed from square to circle 
© A pivot changed from circle to square 


Construction 1: To Identify Basis Pivots 
1. Designate any row as an exceptional row I. 
Mark routes in I with circles. 


In columns with circles, mark unidentified routes with squares. 


2 
3 
4. In rows with squares, mark unidentified routes with circles. 
5 


If all routes are identified, stop. Otherwise resume at 3. 

By Construction 1, each route of a basis becomes either a column pivot (circle) for the 
‘column in which it lies or a row pivot (square) for the row in which it lies. Each designation 
isunique, and exactly one row (say row I) lacks a row pivot. Such a construction is in fact a 
lest of the mathematical condition of "linear independence." If the construction fails for an 
assumed basis, it is not linearly independent, i.e., is not in fact a basis. Figure la contains 
an illustrative basis B for a 5-10 transportation problem. Application of Construction 1 to B 
yields Figure 1b, given that the first row is chosen as rowI. Each column contains a circle, 


and each row, except row 1, contains a square. 


Construction 2: To Trace from Row i to Row I, where i # I. 
1. Locate the square in row i. 
2. Jump to the column circle. If I is reached, stop. Otherwise continue. 


3. Jump to row square. Return to 2. 
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Each square falls in a column with one, and only one, circle; moreover, if circles jp 


row 1 are excepted, each circle lies in a row with one, and only one, square. Asa result, 


any square or circle in Figure 1b can be traced to the exceptional row in a unique way. Figur, 


1c exhibits, for example, the path generated by Construction 2 in going from row 4 to row ], 


Construction 3: Adjust Pivots to a New Choice of I, say I’. 

1. Locate the square in row I'; in passing, make it a circle. 

2. Jump to the column circle and, in passing, make it a square. If row I is reached, 

stop. Otherwise continue. 

3. Jump to the row square and, in passing, make it acircle. Return to 2. 

In Construction 1, the choice of an exceptional row I was arbitrary, and a new choice 
can always be made by a complete reconstruction. This, of course, requires iterative scanning 
of the basis. The same result can be achieved directly by Construction 3. Given that row 1is 
the exceptional row of B, as in Figure 1b, Figure 1d exhibits the changes required to make roy 


4 exceptional. The new disposition of squares and circles is shown in Figure le. 


Construction 4: To Trace a Loop L. 

1. Let Adenote a nonbasis route with coordinates (I,J). Locate A. 

2. Jump to the column circle. If rowlis reached, stop. Otherwise continue. 

3. Jump to the row square. Return to 2. 

The principle of tracing can be generalized; any route (i, j) can be traced to rowl. Of 
particular interest is the fact that a nonbasis route in I can be traced back to I; the trace so 
generated will be called a loop and denoted by L. Starting from route (4, 4) in Figure le, 


Construction 4 generates the loop shown in Figure lf. 


Construction 5: To Displace a Loop Circle. 

1. Given a loop from Construction 4, make Aa circle and drop circle x. 

2. Start at Aand, in passing, make it a circle. 

3. Jump to the column circle. If «) is reached, delete the circle and stop. 

Otherwise, make it a square and continue. 

4. Jump to the row square. Make it a circle and return to 3. 

It is desired to add A, a candidate route in row I, to the basis. As it is also desired to 
retain row I as the exceptional row, 4must go inasacircle. To preserve one, and only one, 
circle per column, some existing circle must be dropped. Along the trace from Ato the circle 
dropped, all pivots must be redesignated. In Figure lf, route (4,4) is A. Assume that route 
(2,9) is to be deleted, and apply Construction 5. The changes to the loop are shown in Figure 
lg, and the adjusted basis B' in Figure lh. 


Construction 6: To Form a Nucleus. 
1. Given a basis with m+n-1 pivots defined, form an m-m nucleus. 


2. Define a new column index k; k=1, 2, ... , m. 
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Select all columns containing squares; arbitrarily renumber with k. There are at 
most m-1 such columns. 

If m-1 columns have not been selected, arbitrarily choose and number columns 
without squares to bring the number to m-1. 

Assume a candidate route A; if the column containing this route has not been 
selected, select it to complete the nucleus. If the column containing this route 
has been selected, arbitrarily choose one more column to complete the nucleus. 

A basis of m+n-1 elements contains n circles and m-1 squares. These squares fall 
inat most m-1 columns. If to these is added one more column, essentially reserving room 
for any possible candidate route, it is clear that m columns can contain all the routes of interest 
to Constructions 2, 3, 4, and 5. Such a subset of columns will be termed a nucleus. In short, 
by nucleus is meant an m-column subset that contains m circles (one per column) and m-1 
squares (one for each row but one.) Typically, the subset is not unique. The circle-square 
configuration of Figure 2 was generated by applying the construction to Figure 1h. 

Now return to the transportation problem with the tools that have been fashioned 
specifically for computer programming purposes. We can decompose a BFS into m-1 squares 
andn circles; we can specify tracing and redesignation operations on a BFS so decomposed; 
and we can gather the squares into an m-column subset of computational interest. Every 
improvement to a BFS involves a loop of changes in X; the loop is required to keep Eq. (2) in 
balance. To enter into a loop, a column must contain (in addition to its circle) a candidate 
route or a square. But all such columns are in the nucleus. By an appropriate selection of 
nucleus columns, therefore, any improvement to an m-n transportation problem can be 
accomplished within the nucleus. 

Formation of a nucleus does not change the original problem being solved: Eqs. (1), 

(2), and (3) hold as always. The nucleus is not a mathematical entity but rather a computational 
trick by which the solution X is partitioned into two parts: a part with some components that 
change in the next improvement and a part that by its nature cannot change. Typically, a 

tucleus will change in composition during the course of computation as one column is dropped 
and another added. 


THE ADJUSTMENT OF X AND U 

It is time to indicate one possible numerical representation of a BFS in terms of squares, 
tircles, and other computational quantities. This is done in Figure 2, where a 5-5 nucleus 
problem is expressed in both graphical and list form. A memory location is reserved for each 
tircle. The location numbers are given by some function g(k) of the column index k. Similarly, 


inthe "square" list, a location is reserved for each row, and the location numbers are a func- 


tion f(i) of the row index i. A tracing operation consists of jumping from one list to the other 


until the exceptional row is reached. All circle-square operations can easily be translated 
wer to concrete algorithms. To meet the needs of any given programming job, of course, the 


‘omposition and the form of the lists would have to be tailored to the program. 
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Assume that a solution vector X is given for an m-m problem or nucleus, and that 
steps 2 and 3 (see p. 172) have located a route, say (p,q), to enter the BFS. The process of 
adjusting X can now be described by the following steps: 

1. Make row p exceptional by Construction 3. 

2. Trace a loop from (p,q) by Construction 4, ascertaining the location (r,s) and 

coefficient x,, of the circle with the "smallest" coefficient. 
Retrace the loop, subtracting x,, from the coefficient at each circle, adding Xrg 


to the coefficient at each square, and setting x equal to x;.. 


pq 
Displace the circle at (r,s) by Construction 5. 


Proceed to the adjustment of U. 


SQUARE LIST CIRCLE LIST 


Location Contents Location Contents 
me U xX =k g(k) : er 2 


f(1) Uy X)) 1 g(1) Xe} 
£(2) U, X33 g(2) X49 
f(3) Uz X35 2 g(3) X43 
f(4) u, --- - g (4) x 
u 


4 
£(5) 5 *54 4 g(5) 














34 
*25 


Figure 2 - BFS expressed in graphical 
and list form 


If the coefficients of two or more circles tie for smallest in step 2, the tie can be 
broken on the basis of indices. For example, break the tie by choosing (r, s) to minimize r, 
that is, remove the circle with the lowest row number. This action assumes that row numbers 
are not changed in the course of computation. The use of row and column pivots makes it clear 
that each row and each column entering into a loop contains a circle-square pair. This implits 
that the row index is sufficient for breaking ties, the column index is sufficient for breaking 


ties, and there is no need to program for both. 


NUMERICAL EXAMPLE OF X AND U ADJUSTMENT ! 

The numerical processing involved in one adjustment of X and U will be illustrated on 
a9-9 problem. Nine storage locations denoted R1 through R9 are allocated to the row list, 
and nine more denoted C1 through C9 are set aside for the column list. The general format 
of Figure 2 is used for the lists, except that cj; information is included for reference purpost 

In addition to the row and column list of Exhibit la, it is given that a candidate route 
(6, 6) is to enter the BFS at a unit saving of 5 (dollars, let us say.) Given that Cee is 15, the 
unit saving is obtained by the application of Eq. (5): 

Ug + Vg - Cgg = 116+ (-96) - 15= 5. 


IThe authors are indebted to the referee for suggesting that a numerical example be included 
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c x j 
21 1 
9 50 6 
13 3 5 
2 

4 


~ 








8 50 
12 70 
exceptional 
6 S21 9 
30 18 5 
25 241 


oo or DO OH CO WwW 


(a) Row and column list at start 





(b) Trace of affected elements in X 


1 
6 
5 
2 
4 
6 
9 
5 
9 


ao 0 Or DO OO Ww 


50 
3 
60 
70 
10 
511 
28 
241 








(c) New values of X; trace for restoring exceptional row 


21 154 Cl - 78 
9 50 C2 - 98 
13 3 C3 - 79 
10 40 C4 -100 
12 70 C5 -100 
exceptional C6 - 96 
6 511 9 C7 -122 
30 28 5 C8 -109 
25 241 9 C9 - 95 


oo mOoOnnAnTnT a , Ww 


(d) Row and column list at start of U adjustment 


Exhibit 1 - Numerical example of X adjustment 
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It is also assumed that the second candidate route will occur in row 1. 

In Exhibit 1a the exceptional row is row 6, as it should be for the processing of a 
candidate route in row 6. At the start, c and j for the candidate route are lodged in R6, the 
location corresponding to row 6. Then, by Construction 4, a loop is traced as follows: Ré6, 
C6, R4, C2, R8, C5, and back to R6. The smallest value of x in the column pivots is 10, 
and this is the value that must be assigned to xgg- In tracing the loop again, add 10 to x in R4, 
R6, and R8 and subtract 10 from x in C2, C5, and C6. This completes the arithmetic adjust- 
ment, but it is still necessary to restore R6 as exceptional. To do this, the trace R6, C6, R4, 
to C2 is traversed again, this time "bumping" x and c each step of the way. When x andc 
are moved, a new i or j is generated to tell which row or column the data were bumped from. 
The trace is illustrated in Exhibit 1c, and the revised row and column list is shown in Exhibit 
ld. The lists are ready for the adjustment of U and V, and it is critical to note that route 
(6, 6) is now in the BFS as a circle in C6. There are two other circles in the exceptional row 
as well; they are stored in C5 and C9, as they were at the start of our example. 

Let U and V denote the columns of u and v before adjustment and U' and V' denote the 
same columns after adjustment. The processing aspects of the adjustment are very simple, 
but a few equations are necessary to show why the processing is so simple. 

One value of u is arbitrarily set by assuming that u does not change for the exceptional 


row. Therefore 
(7) Ug = ug: 


Now by equivalence one can write 
~~ 
=u, + (vy - v,) + (us - Ug) + (v5 - V5) + (ug - Ug) 
= (uy; + v,) - (ug + V4)+ (ug + Vs) - (ug + V5) + Ug ; 
and substituting from Eq. (4) one obtains 
(8) Uy = C11 - gy + Cg5 - Cg5 + Ug: 


Equation (8) will be used later. For route (6, 6) that entered the BFS one has two expressions, 


one that applied prior to its entry and one that applies subsequently. These are 
ug t+ Ve - cgg= 0, from Eq. (4), 


and , 
. Ug + V6 - gg =d66) as in Eq. (5). 


Subtracting the second expression from the first we obtain 


(ug - Ug) + (VG -Vg) - (Cgg - gg) = ~Agg) 


Cancelling and solving for vg we have, since Up = Us 


(9) V§= Ye - Wgg- 


By Eqs- 
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Qne more equivalence is desired. One can write 


' ’ 


Uy = Up + (VE - VE) + (UG - UG)= (UD + VG) - (UB + VE) + UG. 
py Eqs. (4) and (7) this is equal to 
(10) U5 = Cog - Cgg + Use 
Equation (10) can also be written as 
us = Cog - vet (ug - ug) = Cog - a 
substituting for v~ from Eq. (9) we have 


-d 


U5 = Cog - (Vg - Ugg)- 


Using Eq. (4) once more gives 
(11) U5 = Uy + Ye - Yet deg = Uy + deg: 


Equation (7) merely states that u does not change for the exceptional row. This being 
the case, and given a new BFS route at (6,6), Eq. (9) states that v for column 6 must drop by 
dee 

The value of u for a given row is a function of u for the exceptional row and the Cij at 
the row and column pivots that join the two rows. On the trace that joins row 1 to row 6, for 
instance, there are squares at (1, 1) and (3, 5) and there are circles at (3, 1) and (6,5). This 
trace is reflected in Eq. (8), and it will be seen that costs are added at squares and subtracted 
acircles. As Eq. (8) contains no quantities that have changed in the basis change, mere 
inspection of it is enough to show that uj, Vy» Ug, and V5 have not changed. The same can be 
said of any such equation that does not involve CeEg: 

To complete the example, the trace joining row 2 to row 6 is shown in Eq. (10), which 
does involve Cgg- From Eq. (11) it is known that u must be augmented by deg in the second 


tw. These Eq. are illustrative of a general principle: every uy; (not exceptional) that involves 


‘gg Will increase by deg; every vj that involves Ce¢ will decrease by dgg; and every other u; 


or vj is unchanged. 
This principle is exemplified in Exhibit 2, where a systematic scan of the row and 
‘olumn lists has revealed all the circles and squares that trace to C6. The adjustments are 
actually culminated in Exhibit 2b. 
By assumption, the next candidate is in row 1. It is left to make row 1 exceptional, by 
nodifying row and column lists along the lines indicated in Construction 3. All that is involved 
‘satrace from row 1 to row 6, as shown in Exhibit 2c, and the displacement process wherein 


‘ach x and c is moved one step along the trace. The end product is shown in Exhibit 2d. 
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(a) Squares and circles that trace to new element in c6 


99 C1 - 78 

110 (105 + 5) C2 -103 (-98 - 5) 

113 C3 - 79 

111 (106 + 5) C4 +100 

112 C5 -100 

116 C6 -101 (-96 - 5) In gene: 
101 C7 -122 explicit 
130 C8 -109 lon nur 
120 C9 - 95 and the 


(b) U and V adjusted 





- 78 
9 50 -103 
13 3 = - 79 
10 40 -100 
exceptional ——————___ -101 


6 511 9 -122 


30 28 5 C8 -109 
25 241 9 C9 - 95 


(c) Trace to follow in making row 1 exceptional 


exceptional C1 - 78 
9 50 C2 -103 
35 3 C3 - 79 
10 40 C4 -100 
12 70 -100 
16 39 C6 -101 
6 511 C7 -122 
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AN APPLICATION OF PIVOTAL ADJUSTMENT 

Given a hardware system with fast access memory and buffered magnetic tapes, and 
given the pivotal adjustment techniques that have been described, there are many possible ways 
to tackle the transportation problem. The most basic question seems to be: How do you allocate 
the storage of data between memory and tape? We chose to divide cleanly between the nucleus 
and the nonnucleus. All data for an m-m nucleus problem are contained in memory, and from 
time to time this problem is optimized. The remainder of the m-n problem is stored on tape 
by column and is scanned for possible improvements a column at atime. The limit on m is 
dictated by area in memory and the practical limit on n is governed by the capacity of a 
magnetic tape. 

A Univac I code known as XPORT was written with the following parameters: 


If 2<m<8, n<9,000; 
If 9<m<i8, n<6,000; 
If 19<m<2, n<4,000. 


Follow earlier notation, but let an asterisk mean that the nucleus problem is denoted. 
In generating the initial solution, X*, C*, and U are formed in memory (V is not carried 
explicitly). The rest of the problem is stored on tape A by column. Along with its identifica- 
tion number, each column record contains m costs, the amount required at the destination, 
and the row number of the column pivot. Tape B is available as a blank. 

Steps for the cycle of operations are essentially as follows: 

Optimize the nucleus, taking d as large as possible at each improvement. 

At least one nucleus column contains no row pivot; select such a column to write 
on B. 

If there are more columns on A, write a column on B and read a column from A; 
otherwise go to step 6. 

Examine the column from A for maximum dj; if negative or zero, select the column 
for B and return to step 3; if positive, 

Adjust X* and U; return to step 2. 

Switch tape designations. 

If no improvements were made in the completed cycle, end computation; otherwise 
return to step 1. 

Let Q denote the number of improvements and P the number of tape passes, exclusive 
of the initial solution, to complete a computation by step 1 through step 7. For a standard of 
‘omparison, take the well-known procedure of one improvement per sweep of the cost matrix; 
neglecting the final sweep which reveals an optimum, the numbers of improvements and 


sweeps are equal and denoted, say, by R. For computations in which m is less than n, the 
relationship 


P<R <Q or its equivalent P/R<1<Q/R 


vas viewed as a very reasonable hypothesis. To lend quantitative meaning to the relationship, 


lowever, a series of computations was performed. 
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EXPERIENCE WITH THE UNIVAC 1 CODE 
To have determined R empirically would have multiplied the cost of the experiment 


several-fold. R was therefore estimated by the formula 
R= 0.4 (m+ n), 


which, for the type of initial solution in use, was felt to be consistent with prior experience, 
Of the computations reported in Table 1, the first ten were on problems prepared from random 
numbers by a data generator. The last four computations involved two problems with actual] 


data. 


TABLE 1 
Number of Passes P and Number of Improvements 
Q Recorded in FourteenComputations with XPORT. 





m.n Pp Q R | DR Q/R 











5xis | 41/ 11 | 8 | 0.50] 1.4 
5x30 4| 18 | 14 | 0.29) 1.3 
5x60 | 7 | 54 | 26 0.18 | 1.4 
5x120 | 11 | | 50 | 0.22] 2.3 











10x30 | 16 | 0.31 
10x60 | 4 | 28 | 0.14 
10x120 | | 52 0. 19 


15x30 | 33 | 18 | 017 
15x60 | 8| 126 | 30 | 0.27 
15x120 | 271 | 54 | 0.20 


15x488 21 756 


15x488* 7 | 237 
26x872 42 | 2563 


26x872" | 14 | 1220 - - 
eidlete 

*Initial solution using information from the opti- 
mum solution, 























Initial solutions were obtained as follows. Find the minimum unit cost w; in each row, 
and let W denote the column of minimums so obtained. Subtract W from each column in the 
cost matrix C to obtain an "adjusted"' matrix. Then, from the m or fewer sources with 
unexhausted capacity, satisfy the requirements of each column, in turn, at minimum outlay 
by using the adjusted costs. In two cases, starred in the table, W was taken to be the U 
vector from an optimum solution to the problem. These two cases were intended to shed some 
light on the case where problems are recomputed, with minor changes, at periodic intervals. 

In general, the experiment shows the XPORT routine to be quite economical in tap? 


passes; most of the problems are completed in 10 to 20 percent of the tape passes expected 
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yhen one improvement is made per pass. The number of improvements is increased, but if 
each improvement is done very rapidly, the over-all saving in time can be substantial. 

Computational times have not been shown because different problems were run at 
different stages of program development. In general, the running time for the final version 
of XPORT has been approximated by 


Time (in minutes) = =. 


The 15-488, for example, took 20 minutes (21 tape passes and 756 improvements), by the 


formula 


Time = 22 4688 = 24 minutes. 


Another encouraging result is evident from the two recomputations, where the number of tape 


passes has undergone another substantial decrease. 


CONCLUSION 

Two new systems concepts have been examined. Combined in a general program, these 
have contributed to a low number of data passes and, by storage of part of the solution on tape, 
to efficient handling of very long transportation problems. Limited experience with the program 
indicates that computations and recomputations of very large problems are feasible with pro- 
grams of this kind and that the potential class of problems that can be treated economically by 
high-speed computers is enlarged. It is in fact possible that the use of a computer for recom- 
putations can be justified on the basis of clerical savings, and that the value of optimization can 


be obtained as a by-product of automatic processing. 
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This paper is concerned with the transient build-up to steady-state of a 
simple queue system(Poisson arrivals with constant mean rate, expo- 
nential service times with common means, constant number of available 
channels, etc. ). As asubstitute for the tracing out of the detailed build- 
up to the steady-state, a nominal indicator of the time required to reach 
the steady-state is introduced. 


The dependence ofthis nominal build-up time on the system parameters 
(traffic intensity, steady-state mean, etc.) is shown. In particular, if 
there are s service channels, and if m), the meannumberinthe system 
at steady-state, is reasonably large, then this nominal build-up time is 
approximately equal to m/s mean service periods. In some applica- 
tions, this can exceed the duration of existence of the queue discipline, 
thus vitiating the use of steady-state probabilities. 





INTRODUCTION 

A substantial part of the literature on queuing theory and its applications has dealt with 
the equilibrium state or steady-state probabilities. First, many of the applications (e.g., 

Ref. [1]) have been such that the time required to approach very close to the asymptotic 
steady-state is very short, and so mere academic interest lay in the transient build-up to the 
steady-state. Another reason is simply the difficulty of treating the variation of probability 
with time. 

As for the first reason above, it is manifest that there are always new applications be- 
ing considered where the steady-state may not be reached quickly. As for the second consid- 
eration, significant general results have appeared in print somewhat recently (e.g., | 2], [3], 
[4], [5], [8], [9]), but, on the whole, there are not available any simple analytic represen- 
tations of the pre-equilibrium-state probabilities. In any case, even when an equilibrium or 
steady-state exists it is not always clear, from the general results available, how to estimate 
just how long it takes to make the transition from the initial state to the equilibrium state. In 
this paper, the intractability of the more general and complete description of the transition is 
avoided in favor of a simple measure of the effective time elapsed in making this transition. 


This allows sufficient simplicity to obtain a simple representation of this elapsed time. 


*Manuscript received July 8, 1959. 
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We shall consider the simplest and now classical waiting-line model. The arrivals 
entering the system constitute a Poisson process with a constant arrival rate, A arrivals per 
unit time. The service times are independent of each other, and of the arrivals, and are ex- 
ponentially distributed with a fixed mean duration, pol, There is a fixed number (finite or jn- 
finite) of servers available. After completion of service, the freed server takes, for example, 


the earliest arrival to the line (queue). It is supposed that there are no defections from the 
line. 


THE NOMINAL BUILD-UP TIME 

Let s denote the number of servers or service channels available. Let P(t) denote 
the probability that there are exactly n past arrivals still in the system at the epoch t. (The 
"number in the system" includes those being served as well as those still waiting for the free 


server). Then P(t) must satisfy the difference-differential equation. 1, ¢ 
(1) (1/u) P(t) = Py(t) - A/wP I(t), 
(1/u)P,"(t) = (n+1) Py, s(t) - mP y(t) - (A/u) (Py (t) - Py (t)), 1 <n < 8-1, 


(1/u)P,,"(t) = s(P,, y(t) - Pat) - (A/u) (Pplt) - Py_y(t)), 8 <n. 


There are many obvious ways one might attempt to assign a nominal indicator of the 
built-up time. As an example, one might use the least time elapsed before the value of P, I(t) 
approaches within a fraction é, of P (9, where the €, are prescribed beforehand. ° An alter- 
nate approach would be to focus attention on moments of the number in the system. The 
simplest course would be to concentrate only on the mean of the number in the system. This is 
the course chosen in this paper. 

Since the transitory build-up depends on the initial state of the system, let us adopt a 
"standard" initial condition by supposing that the system is almost certainly (i.e., with unit 
probability) initially empty. This, as it will turn out, insures that the mean is nondecreasing 
with t. If the steady-state exists, then the mean, which we shall denote by M,(t), approaches 
a limit as t-»o . Hence, the mean, normalized by the steady-state mean, M, (t)/M, (~), is a 


distribution-type function. Our nominal measure of the time elapsed before the transition from 


see, e.g., Ref. [6], Chap. 17. : 
“In Eq. (1) and throughout the remainder, primes will be used exclusively to denote derivatives 
of the functions indicated. 

3The author gladly acknowledges his debt to the referee for calling his attention to the 
asymptotic rates of convergence of P,(t) to P,(~), which are obtainable from the representa- 
tions introduced by Karlin and McGregor [8]. These provide a means of implementing this 
approach. Using their results, one can show that, e.g., for s=1, A < wp =1, nZ_l, the 


time T,, at which P,,(t) -Py(2 ) = enPp(”) is, as enwo andasA~l, T,~x, (1-vd )-72, where Xp 
is the root of e~* = 2vn x3/2 €n- However. being based on asymptotic results, this approach 
gives reliable results only for sufficiently small ¢,, which in turn lead to large values of Ty. 
For example, if ¢, = 0.01, x, = 2.17. .., andifA = 0.9025, T) = 861. The corresponding 
nominal build-up time T introduced below is, in this case, T = (1-A )-2 = 105. 
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initial state to the steady-state will be taken to be the "first moment" of this "distribution" 
function. Specifically, we take as definition: 


In those cases where the mean number in the system M, (t) is a bounded nonde- 








creasing function of t, and where M (0) = 0, the nominal build-up time is 








if 
i) 


(3) T= [ t dM ;(t) / | dM ; (t) 
0 / LO 
THE FINITE CHANNEL CASE 
Equation (1) above can be written more succintly by introducing the following notational 
use of half brackets: 
Cn ifn<s 


(4) |n| = min (s, n) =< 
|[sifn>s 


In addition to introducing this notation, for simplicity it will be convenient to choose our 
unit of time to be 1/y.. Finally, since n represents the number in the system, n is logically 
restricted to be nonnegative; but it will be convenient if we allow n to range over both positive 


and negative integers but adopt the convention that P(t) = Oifn <0. With these conventions, 


Eq. (1) can be written 


6) P"(t) = [n+ 1 Pp, i(t)-[njP, - 2 Patt : P,-1(t)| 


where now the integer n is unrestricted. If A/ u< s, then the limit indicated below in Eq. (6) 
exists [7]. 


(6) P,(%) = lim P,(t) = P,, 
t 


—+ 0 


and can be determined by noting that the left-hand side of Eq. (5) vanishes as t—>- Thus, the 


asymptotic or steady-state probabilities are determined by 


(7) os [n+1]p - [mn] Pp - A (Pp - Ppa) - 


1 
If we sum both sides of Eq. (7) over all values of n < k, we obtain 
(8) O=[K) PR -APK_y> oe Se ee eee 


(where we carry over the convention that Pp, is defined for all n but that P,* Oif n <0). For 


subsequent reference, we shall note here some results which follow from Eq. (8). 
(9) P= Por y [n|! sn-[n] , 


The value of Pg is determined from the normalization of probability to be 





s-2 ,n 7 -1 
(10) Po = 4 — * sA (s-A)(s-1)! 


Also of interest, 


Ss oo °o 
(11) - (s-n)p,, = - (s-|n| )P, =s- ~ Ap, _y=8-A> 


Ss Cs) re) 
7 n(s-n)p, = 7 n(s-|n| )P,, = sm, - ~ DAP, 1 = (s-A)m, -A, 


Ss 
(13) x n*(s-n)p, = (s-A)m, - 2am, - A, 
0 


where m, and My denote the first and second moments of the asymptotic distribution. The last 
two equations are the first of a series of recurrence equations for the various steady-state 
moments which can be deduced by repeated applications of Eq. (8). The left-hand sides of 
these equations can be simplified by the further application of Eq. (8). For example, 


~ s-l 
(14) 7 n(s-n)p_ =A (s-n)p,_, = A(s-A) - A x P,° 


This, together with (12), leads to 


(15) 





In a similar way, 


_ 2 s-1 
(16) 7, 2 (s-n)p, =r (s-A)m, ~ vA“ + 2A(s-A) - A(s+1) L P,| 
0 0 


which, together with Eq. (12), (13), and (15), yields 


m,(s+A) (s+1 - A) - 2n2 
(17) My = “gh. 
(s - A) 
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Returning to the general equation (5), it will be convenient in subsequent analysis to 
introduce the quantities 





(18) | (t)= P(t) - Pi (=)=P (t)-p. 


Equation (5) then can be written 


(19) Ne * (eet Ine i> Nl _,-1,- =3? 


Summing both sides of Eq. (19) over the index range indicated in (20), we obtain 


n ’ 
Be 2 ; 
(20) ne OP a n 


We now introduce the moments at epoch t as follows: 


(21) M(t) = 2 k"P, (t) 


Let us consider now the derivative of the first moment. We have 


(22) M,(t) = (d/atM,(t)= Dk P= kil, = UV UT 
0 0 k=Q0 k+1 


But . 
(23) > TI k=0 
0 


And so, using Eq. (20 and (23), we can write 


' = fk t \ 
mag EEN 
ve / 


Inthe same way, for the second moment, 


ro 2nt_ 
(25) a ae i. 


y 
0 
y 
0 


(2k + 1) |k+ UN, (ta) (2k + 1)il, 
0 


=- 2(s-A)(M, - m,) - M, + 2 k(s-k) k 


The higher-order moments can be represented likewise, but the first two moments will suffice 
for the goal intended. 


Let us return now to the nominal measure of the build-up time defined above: 


co 


fr tame ‘ 

0 a 

i. ne = (m,) tdM, (t) 
1 | 1 


I, dM, (t) 


Integrating by parts, the last integral is transformed: 


(27) T=-(m,)~ M,(t)-m,| at 
Flom] 
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Now, using Eq. (25), we have 


°o 


Ss 
1 ' 
(28) T- Eek ro 
0 


” s 
m, + - - k(s - k) [I k dt /amy(s - 2). 
0 


In order to evaluate the integral term in the above equation, we may proceed as follows: From 


the difference Eq. (2), we have the representation 


k-1 
(29) (= Py MT olt)/Pg + A) LTT: /Pp 
0 / 


where Pi. is given by Eqs. (9) and(10). Hence, we can write 


e) oo 


“s 5 $ k-1f/.'/ \. 
(30) J 2, kis -k) | x, | ate mm k(s- kp, /Pg Jroaer a Meow | /%y8 


The first integral on the right-hand side of Eq. (30) is defined, since, as can be shown,? |! ott) 
is a nonincreasing function if A/u <s and Po (0) = 1, as assumed. (The remaining integrals 


are clearly defined.) From Eq. (12), the first term on the right-hand side of (30) is equal to 


(31) Py [(s-a) my aif Ig (t) at. 
0 


The second term can be simplified as follows (recalling that P,(9) = 1): 


s k-1/f- ‘ s k-1 
(32) 2) K(s-k)p, >? ( [ ,/»,) at = ») Ks-k)p, | )U (p, -P(0)1/n, 
0 0 0 0 0 


(s-A)my -2A m, -A - [(s-A)m, -A] / Po: 


We have yet to calculate the integral of IT ott): This calculation proceeds as follows: 


Integrating both sides of Eq. (29), and summing over k, 1 Sy Sa, we are led to 


n n n 
; . -1 ( - 
(33) (£1) dt = >» (p, /P9) T g at +A > P,.\K- Pp 
0 0 0 1 
i 
See, e.g., Ref. [8]. It follows, from the representation theory introduced there, that 
n 


if Po (0)= 1, then }) P(t) is a nonincreasing function of t, t > 0 (c.f. proof of Theorem 
> tap gi: 0 . 
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Since the right-hand side of Eq. (33) converges as n — © and since 
n 
T(t) > 0 
0 k 


n 
asn— for every t, and since DT, is a monotone function of t for every n, we may take 
0 


the limit of both sides of Eq. (33) asn—>o. This gives us 


(34) 0= aa Te dt + (m, +1- Py A : 


If we combine the partial results, Eqs. (30), (31), (32), and (34), we obtain 


i) 


Ss 
(35) |. ail yat = (s-A my - m, -m,)/r -m, - 


Hence, finally, 


my + 3m, 


2(s-A)m, 


(36) 





Equation (17) represents My, as a function of m, and the parameter A. If desired, this 


1 


can be used to transform the right-hand side of Eq. (36) to an explicit function of m,, and 


1 
only. If s= 1, then 
(37) o«—); * i 


+ iii + 
(1-A) 


1 
Ifs= 2, then 


2 + m 
(38) oe «Scent? . ta 


“(2+ ay(24a) 


2 3A + 4 
? 2 
(2 + A) 








Although the use of the parameter A or A/s is most common, it appears more natural to use 
m, asa fundamental system parameter in the analysis at hand, especially in order to indicate 


the greater sensitivity of T relative to m If we expand the last term in Eq. (38) in a series 


1 
of descending powers of m,, we have 


T =(1/2)m,"+ (1/2)m, + (5/8) + (1/4)m,~* ‘ o(m,~). s=2 


Returning to the general case of arbitrary but finite s, we can likewise expand T in a series 


of descending powers of m,- In particular, as m,;—> o> 


2 7 
m 2m ' s-1 
(39) he % ; f «go ZL > (:"/a)| + O(1), 
Ss Ss 
Ss 0 
where, of course, the O(1) term depends upon s. 
Figure 1 shows computed values of T as a function of the equilibrium state mean, m,- 
The dotted lines show the first term of Eq. (39), namely m,” s, for comparison. Figure 1 and 
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the general asymptotic result Eq. (39) show aicasccuipipaupaianis 


the great sensitivity of the build-up time 


on 
° 
°o 


to the value of the steady-state mean 
number in the system. As an example 


of the sort of time involved, consider the 





following: A system has 4 servers avail- 





able where the mean service period is 5 
minutes. Thetraffic intensity is such that 
the mean number in the system in the 
steady-state is equal to 3 per service 
channel (a not exceptionally rare situa- 
tion!). Then the build-up time is T = 2.8 





hours. One might conjecture, on the 


NOMINAL BUILD-UP TIME IN MEAN SERVICE PERIODS, Ty 


basis of the infinite server case, that it 





| 
takes a time 2T to 3T before the mean Y | 
| 


number in the system has reached a 





value within, say, 10 percent of the 5 0 20 
STEADY-STATE MEAN, m, 


asymptotic value. In the illustration just 

Figure 1 - The nominal build-up time in 
multiples of the mean service _ period 
about 7 to 8 hours before the steady-state shown in terms of the steady-state mean 
number in the system. The casesof1l,2 
4, and 8 channels are shown. 


cited, this would amount to a period of 


mean number (in the system) is reached, 
a rather considerable period of time in 


view of the 5-minute mean service time. 
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A MATRIX CRITERION FOR STRUCTURAL BALANCE*? 


Frank Harary 


University of Michigan 


A graph [ 8] consists of a finite set of points together with a prescribed collection of 


unordered pairs of distinct points, called lines. A signed graph [| 2] is obtained from a graph 





when some of the lines are designated as positive and the remaining lines as negative. The 
sign of a cycle, or in general of any set of lines, is the product of the signs of its lines. A 
signed graph is balanced if all its cycles are positive. Several criteria for balance have 
already been given. The objects of this expository note are to bring to light another criterion 
for balance in terms of a variation of the incidence matrix of a signed graph and an explicit 
connection between matrix concepts related to the transportation problem and graphical notions 
motivated by psychological applications. The relevance of balanced signed graphs or ''struc- 
tural balance'' as a mathematical model in social psychology is discussed in | 1]. 

For the sake of completeness, we first summarize some obvious characterizations of 
balance for which the following definitions are required. A cycle basis of a graph is a maximal 


collection of independent cycles (see Konig [8]. A positive cycle basis of a signed graph is a 





cycle basis in which all cycles are positive. A signed graph is locally balanced | 3] at a point 


v ifall cycles containing v are positive. A signed graph is N-balanced [3] if all cycles of 


length < N are positive. The degree of balance | i] of a signed graph is the ratio of the num- 


ber of positive cycles to the total number of cycles. 
The following statements are equivalent: 
(1) G is a balanced signed graph. 
G has a positive cycle basis. 
G is locally balanced at each point. 
G is N-balanced for all N. 
The degree of balance of G is 1. 
The equivalence of (1) with (3), (4), and (5) is definitional. The equivalence between (1) and 
(2) is given in Konig [8, p. 152, Satz 13]. 
There are other criteria for balance which are not quite as obvious. Three of these are 
included in the statement of Theorem 2. The bundle at v in a graph G is the set of all lines 


incident to v. 


eens 


*Manusc ript received July 27, 1959. 

This work was supported by a grant from the Office of Naval Research to the Logistics 
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from the University of Michigan. 
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THEOREM 1: The following statements are equivalent: 
(1) Gis a balanced signed graph. 


(2) All paths between the same pair of points u, v have the same sign. 


(3) The set P of all points of G can be partitioned into disjoint subsets Pi and Pp 


such that each positive line joins two points of the same subset and each 
negative line joins two points from different subsets. 
(4) The set of all negative lines of G is the symmetric difference of a collection of 
bundles of G. 
PROOF: The equivalence between (i) and (2) is given in | 2]; between (1) and (3) in [2] 
and in[8, p. 150, Satz 11]; and between (1) and (4) in[8, p. 149, Satz i0]. We indicate the 
proofs here by showing that (1)implies (2) implies (3) implies (4) implies (1). 


(1) implies (2): Consider any two paths joining u and v. The lines of these two paths 





which are not common form a collection of cycles, each of which is positive by hypothesis. 


Hence the noncommon lines of the two paths have the same sign, and so do the paths themselves. 


(2) implies (3): Without loss of generality we take G connected. Let u be any point, 





let P; be the set of all points which are connected to u by negative paths, and let P2 contain 
all other points. Note that u itself is in P,. Then P, and P, satisfy the conclusion of 
statement (3). 

(3) implies (4): The symmetric difference of the bundles at all points of P, (or of P,) is 
is the set of all negative lines of G. 





(4) implies (1): Under the hypothesis of statement (4), it follows at once that each cycle 





of G contains an even number of negative lines. 


Let vj, vg, ---; Vp be the points of G and xj, xg, --. , Xq be the lines of G. Then 


the incidence matrix I(G) of G (with respect to this particular ordering of the points and lines) 





is the p-by-q matrix in which the i,j entry is 1 if v; is on x; and is 0 otherwise. Thus an 
incidence matrix of a graph has exactly two 1's in each column. Similarly one can define the 
incidence matrix of a signed graph by taking the i,j entry as 1 when v; is on a positive line Xj 
and -1 when Xj is negative. But this matrix is not appropriate for characterizing balance. 
Following the terminology of [7], a matrix has the unimodular property if every minor 
determinant equals 0, +1, or -1. A matrix J(G) designed to test a signed graph G for balance 
is defined as follows. First write the incidence matrix I(G), considering G as an ordinary 
unsigned graph. Then J(G) is obtained from I(G) by leaving those columns corresponding to 


negative lines unchanged and replacing in each column belonging to a positive line exactly one 





1 by a -1. It is also permissible to multiply any column of J(G) by -1. 

THEOREM 2: The signed graph G is balanced if, and only if, the matrix J(G) has the 
unimodular property. 

PROOF: The sufficiency is proved in [5] and also in[6, Hoffman's theorem]. The 
necessity is shown in [6, Gale's theorem]. We indicate the reasoning. 

The necessity is proved by induction on the order of the minor determinants of J(G)- 


For order 1, the construction of J(G) gives the unimodular property. Let A be any n-by-n 
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submatrix of J(G) and assume the necessity holds for subdeterminants of order n-1. If every 


column of A has two nonzero entries, then the row sum of the rows of A belonging to points of 


P, equals the row sum corresponding to Py, and |A| = 0. If any column of A has all entries 


zero, then |A| = 0. Finally, if some column of A has exactly one nonzero entry, the expan- 
sion of the determinant |A| , using elements of that column together with the inductive 
hypothesis, assures that A has the unimodular property. 

To prove the sufficiency, let B be the submatrix of J(G) determined by the points and 
lines of any cycle Z of G, where Z is regarded as oriented. Then B can be written in the 


following form where each x= +1 and the missing entries are zero: 


~ 
>, 4 








« & 
a xX X 


If Z is a negative cycle, then it is easily seen that |B! = +2, contradicting the hypothesis that 


J(G) has the unimodular property. Hence Z is positive and G is balanced. 

We note that Theorem 2 above began as an application of the simplex method to a 
transportation problem by Dantzig, was generalized by Heller and Tompkins [5], simplified 
by Hoffman in |6], and proven in a converse direction by Gale in [6]. 

A graph is bichromatic if it is possible to assign one of two colors to each point in such 
away that no two points of the same color are adjacent. Konig has given the following 


characterization: A graph is bichromatic if, and only if, each cycle has even length. 


COROLLARY: The incidence matrix of a graph G has the unimodular property if, and 
only if, G is bichromatic. 

PROOF: This follows at once from Theorem 2 by regarding G as a signed graph in 
which all lines are negative. 

The corollary appears in|7, p. 233]. 

One can ask for the conditions under which a minor determinant of J(G) for a balanced 
signed graph G is zero or nonzero. (The difference between the values +1 and -1 is 
immaterial. ). This question is answered by the next theorem. Let D be any minor deter- 
minant of J(G). Let P(D) and L(D) be the points and lines of G belonging to the rows and 
columns of D in J(G). Note that P(D) U L(D) need not be a subgraph of G since there may be 
lines in L(D) whose endpoints do not both appear in P(D). Let 


{D} = P(D)UL(D). 


An isolated point (01 isolated line) of {D} is a point (or line) which is not on any line (or point) of 


'D). We say that {D} contains a cycle Z of G if all the points and lines of Z are contained in {D}. 
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In order to investigate whether or not a minor determinant D of J(G) vanishes, there 
are two situations which it is convenient to exclude. In the first of these, {D} contains a Point 
which is on exactly one line. In the determinant D, this event is realized by a row which cop- 
tains exactly one nonzero element. On deleting the row and column containing this element, 
we are left with a smaller determinant which vanishes if, and only if, D does. We shall not 
spell out the entirely analogous situation in which {D} contains a line which lies on exactly one 
point. In the following theorem, we consider a determinant in which these two kinds of deletion 


have already been carried out as far as possible. 


THEOREM 3: Let G bea balanced signed graph. Let D be a minor determinant of 
J(G) such that {D} does not contain any points which lie on exactly one line or any lines which 
lie on exactly one point. Then D = Oif, and only if, {D} contains an isolated point or an 
isolated line or a cycle.! 

PROOF: The sufficiency is immediate. For an isolated point or an isolated line of 
D induces a zero row or a zerocolumnin D sothat D = 0. If, on the other hand, D 
contains a cycle Z, then the points and lines of Z form a direct factor of D and it is easily 
seen that the determinant J(Z) of the matrix J(Z) of a cycle Z with an even number of 
negative lines is zero. 

To prove the necessity, let D be a minor determinant of J(G) satisfying the above 
hypothesis such that D= 0. Assume that {D} has no isolated points or isolated lines. Now by 
hypothesis, {D} does not have any point on exactly one line or any line on exactly one point. 
Hence each point of {D} is on at least two lines, while each line is on at least two points. This 
last incidence condition assures us that {D} contains a cycle. 

We note that the reasoning in the proof of Theorem 3 is similar to Tutte's proof [9] of 
the very interesting ''matrix tree theorem for directed graphs. "' 

A signed graph is antibalanced | 4] if its negation, i.e., the graph obtained on changing 
the sign of all lines, is balanced. Corresponding characterizations of antibalance are immedi- 
ate. In particular, the analogue of Theorem 2 involves the construction of a matrix J(G) 
obtained from J(G) by changing the sign of exactly one nonzero entry in each column. A signed 
graph is duo-balanced if it is both balanced and antibalanced. A condition for duo-balance 
corresponding to Theorem 1, part (3), is given in [4]. We note that G is duo-balanced if, and 


only if, both J(G) and J(G) have the unimodular property. 
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It has been suggested that this journal might serve as a medium for publishing problems in 
the area of Logistics — with the idea that other persons might be interested in those problems 
and might submit comments. Readers are invited to submit brief statements on applied and 
theoretical problems in Logistics. Address letters to Managing Editor, Naval Research 
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DETERMINING AN OPTIMUM REJECT ALLOWANCE* f 


Bernard Giffler 


IBM Research Center 
Yorktoun Heights, New York 


An optimum scrap allowance, a*, is defined as that value ofa which | 
maximizes the return function | 
a 
r(a)=¢ p(O <x < a; ni a)-p >» [(a-x) p (xi in 4 a)], 
0 


-~ = 


where n is thenominal] lot requirement, x the numberof scrapped uniis, 
yu the cost per unit of surplus, and ¢ the penalty cost which results when 
the actual scrap exceeds the allowance. The value a¥* is determined by 
an algorithm for which the computing problem is viewed as a multiple- 
stage problem, as in dynamic programming. 
|} given for the cases where the 
Poissonian. 


Numerical examples are 
scrap probabilities are binominal or 


INTRODUCTION 


Reject allowances are added to production orders as protection against the possibility that 


manufacturing losses will result in an insufficient quantity of good units. In determining this 


allowance the costs of both producing fewer or more units than the nominal requirement must 


considered. An optimum allowance is one for which the long-run combined costs of the 


shortages and surpluses are minimized. 


"Manuscript received August 6, 1959. 
Written as IBM Research Report RC-49. 





If the number of rejects were known in advance, one could simply set the reject alloy. 
ance equal to this number. This allowance would be optimum since neither a shortage nor assumi 
surplus could result. Unfortunately, the number of rejects is almost never known in advance. can thu 
except as a probability distribution. a) 
The calculation of an optimum reject allowance is difficult when reject probabilities ay, 
dependent on the size of the order since for this case many possible lot sizes have to be taken 
into account. A way out of the difficulty is to assume that the reject probabilities are not de. 
pendent on order sizes [1]. This might be reasonable if order sizes were large relative to the oT. 
number of rejects. The approach described here is based on the assumption that the reject 
probabilities do depend on the order sizes. A separate computation of the reject probabilities 
for all possible lot sizes is avoided by the use of an algorithm in which the computing problem 


is viewed as a convergent multiple-stage process. smalle 


integer 
THE RETURN FUNCTION 


If n units are required of some manufactured commodity and we add to n an allowance 
of a units, we will save an amount 9 (the cost of back-ordering) if the number of rejects does 
not exceed the allowance. The expected saving will be 9: p(0 <x <aj;nt a), where x is the 
number of rejects and n+a is the size of the order. 

If there were no other considerations, we would make the allowance as large as possible. 
Unfortunately, the larger we make the allowance, the larger will be the surplus of allowance 


over rejects. If the cost per unit of surplus is i, the expected cost of the surplus will be 


a 


ive » (a-x) p (x; n+ a). 
x=0 


The expected return on an allowance of a units is the expected saving less the expected 


cost of surplus; that is, 
added 1 


next 2 


a 
(1) ra)=9-p(<x<a;n+a)-u >" (a-x)p (x; n+ a). 
x=0 


In this equation, a is the variable; the apparent variable, x, is eliminated in the indicated a, can 
summations. equatic 
The optimum allowance is defined as that value of a, say a*, for which the return 
function, r(a), is maximized. It can be noted from Eq. (1) that the optimum allowance will be ) . 
infinite whenever the cost of a unit of surplus is zero or the probability of any unit being re- 


jected is 1. Accordingly , we assume that pu # 0, p(1,1) 4 1. 


MAXIMIZING THE RETURN FUNCTION 
The following method for maximizing r(a) is proposed to avoid the computational diffi- 


culty in (1) caused by the fact that the order size (n+a) is itself a variable. We begin by 
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assuming that it is impossible for any unit of the allowance to be rejected. The return function 


can thus be stated as 


(2) a 
rp@)=9 > p(<x<a;n)-u Lo (a-x) p(x; n), 
- 4 = 


where the subscript zero is used to indicate the zeroth step of an algorithm. 


Setting Ar (a) equal to r p(a+ 1) - r g(a) and substituting from (2), we obtain 
Arp(a)=9* p+ l;n)- 4+ p& <a;n). 


We argue next that maximum r,(a) will occur at that value of a, say a,, which is the 


0’ 
smallest integer for which Ar (a) <0. This is the same as stating that ao must be the smallest 


integer which preserves the inequality 


ix < as a 


) »~-tEr te 


Suppose that having determined ay we wish to correct for the assumption that no unit of 


ay can be rejected in manufacture. Specifically, we decide to determine a new allowance 


a 2% which will be optimum if we assume, again, that it is impossible for any one of the 


4-4) added units to be rejected. Now the return function becomes 
a 


)- pe (a - x) p (x; n+a,) 
0 oh 0 


NS XN a,nt+a 


0 
>» (ay - x) P (x; n + ay) 


The first term to the right of the equality sign in (5) is the expected saving if the 
added units, a,-ap» are sufficient to prevent the number of rejects from exceeding ar: The 
next 2terms, taken together, subtract the net increase in the cost of surplus. 
The method by which Ao» the first approximation to the optimum, a*, was improved to 
4, can be reapplied. In fact the improvement can be continued as long as desired. The general 


equation for the return function at the . iteraction is 


=o 
« j-l 
(6) ri(a) = O° M( aj. 4 2 a a aj-1) a » (a-x) © (x; n + aj-1) Te } i (aj. 4-*) py (& nt+aj.4)-" 
xO x=0 
The a, which maximizes r (a) is the smallest integral value of a for which 
Ar, (a) = r@+ 1) - x(a) <0. 
This is the same as to require a, to be the smallest integer for which 
p(x Na;n+ a;.1) 
; (a) = 


pa +I;n+ aj.) 


¢ 


>—. 
mM 








The preceding algorithm, because of the discreteness of x, does not endlessly refine 
the estimate of a*. In almost all examples which we have worked out, ay turned out equal to 
ay: When this happens, the lot size is not increased for r.(a) where j >1, which means that 


ay =a, =a, =--- = a*. We can therefore state immediately! that a, = a* and in the genera] 


2 
= qa*¥ ji = 
case that a a* if ay ay 1. 


0 


A CONDITION FOR THE UNIQUENESS OF THE OPTIMUM ALLOWANCE 
To prove that of (a) is unique, it must be shown that g.(a) is a never-decreasing function 


of a. The implication here (substituting from (4)) is that 


p(x <a - +d < P( < a) 
~ p(a) spa + 1) 





or that 


(10) 
where 
A p(a) = p(a+1) - pfa). 


The condition that gj (a) be never-decreasing is automatically assured when we assume 
binomial or poisson probabilities. Assuming binomial probabilities, for example, we can 


calculate that 


+ ! 1 
(a a? (n-a-1) | Soe a-—) ** 


n!p ow 


_ (a+1) ! (n-a-1) ! (1- , aD ! (n-a-1)!(1-p) 
—. a+l at *"al(@-a)!ip 


a+l 
p) 





O!n!p 
and that 


g,(a- 1) = 2! (n-a) ! (1-p)* +... ¢ 2! (nea) ! (l-p) 


O!n! pa (a-1) ! (n-a+1) ! p 


Comparing the two series, we see that each term of CF (a-1) is less than a corresponding term in 
z 

g(a) and hence that 8; (a-1) < 8; (a). The same nana can also be used to show that condition 

(10) is realized when ‘the pveninaniies are Poissonian. In fact, only in specially contrived ex- 


amples has the condition been noted not to hold. 


The proposed algorithm was originally developed by a heuristic line of reasoning similar to 
that which is described. The proposal has been more recently investigated by A. Cobham (0 
IBM), who snowed that the algorithm must converge exactly on a* when the probabilities ™ 
Eq. (6) are binomial. R. E. Levitan (of IBM) has extended the applicability of the alg sorithm 
to all probability distributions for which the probability of a reject is independent of the occur- 

rence of previous rejects. This result and several other new results by Levitan will be de- 
scribed in a forthcoming paper, ''The Optimum Reject Allowance Problem." 


Actually, we have proved the stronger condition, namely, that 8 ;(a) is always increasing 


r 


exceed | 


exceed | 


NUMER 


- 


determi 


iterative 


(11) 


denomin 


(15) 


This is 1 
paramet 
s 
(I). Fe 


may not 





erm ill 
ndition 


1 ex- 


205 


The condition that 8; (a) be nondecreasing is not sufficient to insure that 8; (a) will ever 
exceed 9 /. However, no special condition is necessary to insure that g(a) will eventually 
exceed 9 /Z, since 8; (a)>o as a>n+ aiiy (see Eq. (8)). 


NUMERICAL EXAMPLES 
The algorithm defined by Eqs. (6) and (7) provides a relatively painless method for 


determining the optimum allowance. We may note, for example, that 8; (a) can be determined 
iteratively by the equation 


p(asn + a,_,) 


(11) g; (a) = p (a + 1; n + a;_;) : | ¢, (a-1) - 1, 





p(O;n+ a. ,) 
g.(0) = S 


j p(1;n+aj_4) 





If we assume binomial probabilities, Eq. (11) becomes 


., _ (a+i1j)a 
(13) g; (a) a a le, (a-1) + 1], 
j-1 
Where A = (1-p) / p. Equation (12) becomes 


(14) 


Where it is anticipated that n will be large relative to a, we may drop the a in the 
denominator of (13), thus obtaining 


~(a+1)a . 
g; (a) at ay [e, (a-1) + 1]. 


1) 


This is the same as to approximate the binomial distribution by a Poisson distribution whose 
warameter is np/(1-p). 


Table 1 shows the value of E, (a) calculated for a hypothetical example by Eqs. (13) and 


(i). For this example, n is assumed to be 100, p to be .05, and @/uto be 1.00. The reader 


may note that ay = 3 for both equations and that ay = ap so that a* is also 3. 


TABLE 1 
Calculated Values of &)(a) 


Method la =O ja=1 
‘Eq. (13) - Binomial Dist. 0.19 | 0.45 
Eq. (15) - Approx. Binomial | 0.19 | 0.45 
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REMARKS ON THE ESTIMATION OF THE PARAMETERS 

The cost of a unit of surplus, », depends primarily on the prospects for the future use 
of the surplus. If these prospects are very good, 4 may be taken to be the expected cost of 
carrying the item in inventory. If the prospects are practically nil, 4 might be taken to be the 
unit cost to manufacture the commodity. 

The estimation of the cost, ¢, incurred when rejects exceed the allowance, is more 
difficult, particularly since @ will include not only the conventional setup cost to back-order 
commodities but also the cost of disrupted schedules and lost good will. If these costs cannot 
be easily determined, it may be advisable to set lower limits on the allowance so that the 
number of rejects will exceed the allowance with, at most, a small, predetermined probability, 


The size of this probability might have to be determined by "executive decree." 


There will be two main difficulties in estimating p. One is that there may be insufficiey 


data for a reliable estimate; the other is that p may not be in statistical control [2]. If there 


is insufficient data to estimate p for a given commodity, one might (to get started) use an 


estimate of p for a similar commodity or class of commodities. To check for the absence of 


statistical control, one might run a control check for fraction defective [3]. If there is no 


control, p cannot be estimated except, possibly, by some subjective method. 


CONC LUSION 


A mathematical model and numerical method have been developed to determine optimum 


reject allowances. Necessary inputs for the model are the number of required units (the 
nominal requirement), the ratio of the cost of producing less than the nominal requirement to 
the unit cost of production, and the probability that a unit will be rejected. 

The effectiveness of the model depends on the appropriateness of its assumptions, 
particularly the assumptions that the penalty-cost for having to back-order is independent of 
the size of the back-order and that the cost of manufacture can be broken down into a fixed 
cost per lot and the product of the lot quantity and a constant unit-production cost. Where the 
assumptions hold, the model and numerical method should determine an optimum allowance 


with a reasonable computational effort. 
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RECENT PUBLICATIONS 


THE ANALYSIS OF VARIANCE, by Henry Scheffe. John Wiley and Sons, New York, 
1959. xvi+ 477 pp. 

Suppose that we have n observations or measurements and assume that these observa- 
ang are values taken by n random variables Yy> Yor «++» Vq> which are constituted of linear 


combinations of p unknown quantities 5 p p grt? Bp plus errors Cyr Cor eee» One 


= a .B ee 
(*) A “a 3 * “e's” 
Ws 45.2) css. 0 
where the {Xj} are known constant coefficients. Further, suppose that the random variables 
{e;} have zero means, are uncorrelated, and have equal variance o2, Then Scheffe defines the 
analysis of variance as the body of statistical methods of analyzing measurements generated 


from a model such as (*), where the coefficients {Xi} are integers, usually 0 or 1. If the 





i} are continuous variables, then we have a case of regression analysis; and if there are 





some {Xji} of both kinds, we have an analysis of covariance. 

After point estimation and the theory of the F-test and confidence ellipsoids have been 
carefully covered, the rest of the first half of the book deals with what is termed the "fixed 
effects model," i.e., where the {83} are unknown constants and where the errors are normally 
distributed. By use of this model the theory of one-way and higher-way layouts and some in- 
complete layouts (latin squares, incomplete blocks, and nested designs) are considered, fol- 
lowed by a chapter on the analysis of covariance. 


The second half of the book is essentially concerned with the effect of changing or relax- 


ing all the assumptions needed for the fixed-effects model. Some or all of the {85} are allowed 


to be random variables, and consideration is given to the cases when the errors are either 
nonnormal, not independent, or do not all have the same variances. The results of this half 
may be less definite than those in the first half of the book but they are probably more im- 
portant, being more applicable to the real world. 

The approach throughout is clear, rigorous, and concise, with matrix notation used 
continuously; this makes the book more directly useful for the mathematical statistician rather 
than for the applied statistician. Many of the results discussed have previously been dealt with 
only in research papers, and the book provides such an admirable and complete coverage of the 
field that it ‘will undoubtedly be the standard text on the subject for many years to come. 

The most important of a long list of Appendices are certainly the complete Pearson and 
Hartley charts and Fox charts for the power of the F-test. The layout and production are up to 


the usual excellent standard of the Wiley Publications in Statistics. 


209 (Reviewed by C.W.J. Granger) 





RECENT PUBLICATIONS 


SAMPLED-DATA CONTROL SYSTEMS, by E. I. Jury. John Wiley and Sons, New York, 
1959. $16.00 

The central analysis problem of a sampled-data control system arises because of the 
necessity to handle two kinds of data, continuous and discrete, in one integrated system. For 
the continuous parts of the system, powerful methods, stemming from the Laplace transform, 
exist and, therefore, the general efforts for the above problem concentrate on the development 
of compatible techniques for the discrete data. These efforts range from continuous approxi- 
mation of the discrete data (convolution in the time domain) to outright use of discrete inputs 
(z-transform method). Lying somewhere between but not independent of these two extremes js 
the modified z-transform method developed by Barker in England and extended so competently 
by Professor Jury in this John Wiley text. Of course, any method implies the ancillary problem 
of error analysis and goodness-of-fit to the original signal. 

Professor Jury’s object in this erudite text is “. . . to develop a basic theory that can be 
applied to sampled-data systems, to other allied fields such as circuits, networks, and com- 
puters, and to the general field of system engineering . . .” On the whole, this goal is accom- 
plished and more. The writing is precise, lucid, and thorough. One might wish for a bit more 
editorializing in spots and probably for the beginner this book should be supplemented by lec- 
tures. Incidentally, words, of course, are cheaper to print than equations and diagrams and 
supplementary discussion would only dilute the present three and one-half cents per page toa 
more reasonable figure. However, Professor Jury has included numerous clarifying examples 
and this fact plus the selection of material and arrangement of chapters makes the whole theory 
of modified z-transform credible and functional. In some of his examples the modified z-trans{m 
method is cumbersom and seems needlessly applied; but, presumably, these are intended to be 
simple examples illustrative of the technique. 

The material covered includes the z-transform, modified z-transform, root locus methods, 
and frequency response methods. This last is probably due to Linville; which brings to mind tha 
an excellent bibliography is collected in the back of the book. Discrete and continuous compensi- 


tion methods are followed by a chapter on physical realization of discrete compensation including 


the work of Salzer. Chapter 8 is an approximate analysis of continuous systems; and Chapter 9 
consists of relatively new material from the research of Professor Jury and some of his stu- 
dents, particularly, according to a footnote, Farmanfarma at Berkeley. 

It is a pity Professor Jury did not include some discussion of adaptive systems or 
demonstrations of optimum design. Perhaps a future book by the same author is called for. 
In the present text, there are many examples, many good problems, and no serious errors 


found by this reviewer. It meets its objective but, as was implied, it is $16.00. 


(Reviewed by E. C. DeLand) 
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RECENT PUBLICATIONS 


ALLGEMEINE METHODENLEHRE DER STATISTIK, BAND I, ELEMENTARE 
METHODEN UNTER BESONDERER BERUCKSICHTIGUNG DER ANWENDUNGEN IN DEN 
WIRTSCHAFTS- UND SOZIALWISSENSCHAFTEN, by Johann Pfanzagl. Sammlung Goschen, 
vol. 746/746a. Walter de Gruyter, Berlin, 1960. DM 5.80. 

This is the first of two volumes on statistical methodology. The present booklet is designed 
for the needs of social scientists, while the second volume will primarily be concerned with 
applications of statistics in the natural sciences. The mathematical prerequisites do not go 


peyond the subject matter treated in German and Austrian secondary schools (the author is 


professor at the University of Vienna, Austria) and includes therefore a modest amount of cal- 


culus. The booklet starts with the presentation of some basic concepts and results of mathe- 
matical statistics; the reader is referred to the second volume for mathematical details and 
proofs. In view of its prospective use, descriptive statistics and sampling procedures are 
emphasized. The author gives many examples and uses them cleverly to warn the reader against 
possible pitfalls. The following is a listing of the chapter headings: (1) Basic concepts; (2) Fre- 
quency distributions; (3) Parameters; (4) Statistical errors; (5) Sampling methods in economic 
and social statistics; (6) Statistical aggregates; (7) General theory of statistical measures; 
(8) Computation of index numbers; (9) Some examples of index numbers; and, (10) Time series 
analysis. 

Three appendices (on obtaining the data and on computational and graphical treatment of 


the data) as well as references and an index conclude the book. 


(Reviewed by Eugene Lukacs) 
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